Full Stack AI Engineer, 3D Agents and Gaming

Ego is building an Infinite Game - a persistent virtual 3D world where lifelike AI agents are able to interact with players and each other to build their own relationships, communities, and games within the game. Our embodied AI agents can perceive the world in 3D, reason like a human, and write scripting code directly into the game engine.

We're looking for someone with expertise in computer vision, transformer models, and AI agent development to create a versatile AI system capable of real-time perception, reasoning, and action execution within various 3D game environments. The ideal candidate will have a strong background in full stack engineering, applied research, reinforcement learning, and experience with cutting-edge LLM-based systems. This role will involve pushing the boundaries of AI in gaming, similar to projects like Minecraft Voyager, while integrating seamlessly with our existing game development ecosystem.

Responsibilities

• Design and implement end-to-end AI solutions, from backend infrastructure and APIs to front-end interfaces, ensuring seamless integration with existing gaming systems
• Develop and deploy applications that leverage LLMs for natural language understanding, dialogue generation, content creation, and enhancing player experiences
• Integrate and optimize computer vision models for tasks such as object detection, scene understanding, character animation, and immersive gameplay experiences
• Ensure AI models and applications are optimized for performance, scalability, and efficiency in a real-time gaming environment
• Collaborate closely with design and engineering to implement UI and new features for mobile & desktop applications
• Implement and integrate third-party SDKs and addons
• Identify and resolve bugs, bottlenecks, and performance issues
• Adhere to and improve upon existing architecture and code quality standards
• Work with backends such as AWS and Azure

Qualifications

• 3+ years in full-stack engineering with a focus on AI/ML, preferably in simulation, robotics, or gaming
• Proficiency in programming languages such as Python, C++, and JavaScript
• Experience with AI frameworks and libraries like TensorFlow, PyTorch, and OpenCV
• Strong understanding of full stack development, including front-end frameworks (e.g., React, Angular) and back-end technologies (e.g., Node.js, Django)
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization tools (e.g., Docker, Kubernetes)
• In-depth knowledge of database design and management (SQL, NoSQL) and experience with big data technologies
• Familiarity with continuous integration/continuous deployment (CI/CD) processes and tools
• Experience shipping and maintaining full-stack AI projects on both mobile and desktop platforms
• Deep understanding of AI/ML concepts, algorithms, and techniques, with hands-on experience in LLMs (e.g., GPT-3, LaMDA), computer vision (e.g., CNNs, object detection), and robotics
• Strong understanding of object-oriented programming and design patterns
• Ability to self-manage and work independently or collaboratively as needed
• Has experience with Version Control such as Git or PlasticSCM
• A strong interest in video games and a desire to contribute to the future of interactive entertainment
• Strong communication and collaboration skills, with the ability to explain complex technical concepts to both technical and non-technical audiences

Preferred (Nice to have)

• Experience with a game engine, such as Unity, Unreal, or Roblox
• Contributions to open-source AI projects
• Experience with reinforcement learning
• Familiarity with game AI design principles
• Knowledge of industry-standard software development practices and methodologies
• Top 500 on Overwatch
• Has seen all X Fast and Furious movies