Technical Writer (Machine Learning)
ETCHED LLC - cupertino, CA
Apply NowJob Description
About Etched Etched is building AI chips that are hard-coded for individual model architectures. Our first product (Sohu) only supports transformers, but has an order of magnitude more throughput and lower latency than a B200. With Etched ASICs, you can build products that would be impossible with GPUs, like real-time video generation models and extremely deep chain-of-thought reasoning. Technical Writer & Designer (Machine Learning) At Etched, we are creating machine intelligence at the next level. But it is useless unless humans can understand it. We hope you can join us to make this powerful machine intelligence understandable by humans and easily usable by humans. With Etched ASICs, we have fundamentally different constraints than existing AI chips. We don't have the same batch-size-latency tradeoff as GPUs. We can parallelize workloads and digest large contexts much more efficiently than GPUs. Sohu enables entirely new research directions and products. When our chips come out, these use cases need to already be mature and visceral. Whether real-time video, agents, speculative decoding, or new tree search algorithms, we must create the market for our hardware. If you like to create beautiful things, using AI-tools, for humans to use AI-tools, come and join us as Transformer-based machine intelligence is about to fundamentally change human life - if not already. Representative projects Design UI/UX for powerful LLMs that goes beyond "chatting" Design and enhance interactive google colab-based demos for both hardware and software ML products Implement doc-gen system like (python sphinx) for APIs and references Write tutorials and quickstart guides Visualizing continuous batching for LLM inference You may be a good fit if you are/have Excited and optimistic about AI Hunger to learn and use AI day to day Passionate about open source software and models Comfortable with reading and writing code, using CLI, scripting An exceptional communicator, both verbal and written A strong portfolio of UI designs and visualization Strong mathematical background, especially linear algebra The ability to understand and visualize abstract concepts rooted in academic research We encourage you to apply even if you do not believe you meet every single qualification. Strong candidates may also have experience with: Software/Web UX workflow design Software/Web UI design and mockup Google interactive python colab Python sphinx, readthedocs C++ doxygen Markdown Javascript, typescript with electron framework How we're different: Etched believes in the Bitter Lesson. We think most of the progress in the AI field has come from using more FLOPs to train and run models, and the best way to get more FLOPs is to build model-specific hardware. Larger and larger training runs encourage companies to consolidate around fewer model architectures, which creates a market for single-model ASICs. We are a fully in-person team in Cupertino, and greatly value engineering skills. We do not have boundaries between engineering and research, and we expect all of our technical staff to contribute to both as needed. Benefits: Full medical, dental, and vision packages, with 100% of premium covered, 90% for dependents Housing subsidy of $2,000/month for those living within walking distance of the office Daily lunch and dinner in our office Relocation support for those moving to Cupertino
Created: 2024-11-05