We are looking for experienced Senior Python Software Engineers / Tech Leads to work on an AI-focused software engineering project involving real-world open-source codebases and LLM evaluation.
You will work hands-on with GitHub repositories, troubleshoot and triage software issues, configure development environments, evaluate test coverage, and assess how effectively LLMs can understand and fix real-world software problems.
Key Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure software repositories and development environments.
- Work with Docker and local development environments.
- Evaluate unit test coverage and test quality.
- Modify, run, and test real-world Python codebases locally.
- Assess LLM performance in software bug-fixing scenarios.
- Collaborate with researchers to identify challenging repositories and issues for LLM evaluation.
- Potentially lead and collaborate with junior engineers.
Required Skills
- 5+ years of overall software engineering experience.
- Strong Python programming experience.
- Proficiency with Git and Docker.
- Understanding of basic software pipeline setup.
- Ability to navigate and understand complex codebases.
- Strong debugging, testing, and problem-solving skills.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience with open-source projects is an advantage.
Nice to Have
- Experience with LLM research or LLM evaluation projects.
- Experience building or testing developer tools or automation agents.
- Experience working with public GitHub repositories.
- Previous experience in AI/ML or developer-focused AI projects.
Work Requirements
- Minimum 8 hours per day / 40 hours per week.
- Must be available for at least 4 hours of overlap with PST.
- Fully remote opportunity.
- 3-month contractor assignment.
- Contractor role does not include medical or paid leave.
Why Join?
Work on a cutting-edge AI project focused on evaluating how Large Language Models interact with real-world software code, combining practical software engineering with AI research.
Interested candidates can apply with their updated resume.
anusya@destinareservices.com
Pay: Up to ₹150,000.00 per month
Application Question(s):
- Do you have hands-on experience with Git, Docker, and working with complex codebases?
- Do you have experience analyzing, debugging, modifying, and testing real-world Python projects or open-source GitHub repositories?
Experience:
- Python: 3 years (Preferred)
Work Location: Remote
