Junior Software Engineer – AI/LLM Systems at Epiq
**Who this is for** This position is for an entry-level software engineer with a strong foundation in Python and cloud development, eager to specialize in AI an
Work type: onsite
Location: USA-New York-NY-777 Third Avenue
Salary: $80,000 – $95,000/yr
Type: Full-time
Summary
**Who this is for** This position is for an entry-level software engineer with a strong foundation in Python and cloud development, eager to specialize in AI and large-language-model systems.
**Key highlights** You will work under the guidance of senior engineers to ship AI-powered features, manage RAG pipelines, and build tools that improve model performance and system reliability in a production environment.
**You might be a good fit if you...** - Hold a Bachelor’s degree in Computer Science or a related technical field.
- Have practical experience building and deploying production-grade code using Python.
- Are familiar with cloud-native development practices, including containerization and CI/CD pipelines.
- Demonstrate a foundational understanding of machine learning concepts and a proactive desire to learn LLM workflows.
Job Description
At Epiq, your work contributes to complex, global legal outcomes. You’ll join a values‑driven community where integrity guides decisions, relentless service sets the bar, and wethrive on big challenges together. We invest in your growth with enterprise‑wide learning and mobility. We celebrate who you are, and we respect life beyond work with flexibility that’s recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful work of your career and see your impact at scale.
Job Description:
# Job Summary
We’re building cutting‑edge AI‑powered products and need a junior engineer who is eager to learn about large‑language‑model (LLM) technology while helping us ship new features. If you enjoy working on real‑world products and want to grow your skills in AI, this role is for you.
Essential Job Responsibilities
- Build and ship AI features with LLMs, retrieval‑augmented generation (RAG) pipelines, embeddings, and simple multi‑model workflows under guidance from senior teammates.
- Help design low‑latency, high‑accuracy systems that can scale reliably in production.
- Support cloud operations on AWS/Azure, learning how to keep costs under control.
- Create prompt libraries and participate in evaluation pipelines, guardrails, and automated quality checks.
- Collaborate with product and linguistics experts to translate user stories into concrete rules and domain logic.
- Run benchmarks and tweak models for accuracy, performance, latency, and cost, reporting findings to the team.
- Build internal tools for prompt iteration, dataset curation, and model evaluation with guidance from more experienced engineers.
Qualifications & RequirementsEducation- Required: Bachelor's degree in Computer Science, Information Technology, or a related field.
- Preferred: Master's degree in Computer Science or a related field.
Skills- Production‑grade software engineering – Proven experience building, testing, and deploying code in live environments.
- Python mastery – Comfortable writing clean, idiomatic Python (3.x), using core libraries and data‑science tools (e.g., pandas, NumPy, scikit‑learn, FastAPI, Django).
- Cloud‑native development – Hands‑on experience with cloud platforms (AWS, GCP, or Azure), including IaC (Terraform, CloudFormation), serverless functions, container orchestration (Kubernetes), and CI/CD pipelines.
- Basic ML/LLM awareness – A foundational grasp of machine‑learning concepts and large‑language‑model principles, paired with a genuine curiosity to dive deeper.
- Observability & performance – Familiarity with monitoring, logging, and tracing in distributed systems (Prometheus, Grafana, ELK stack, OpenTelemetry).
- Optional advanced exposure – Experience with vector databases, retrieval‑augmented generation, or prompt engineering is a plus, but not mandatory.
- Product‑oriented mindset – Ability to translate technical ideas into user‑centric features that delight customers.
- Growth‑oriented teamwork – Eager to learn, proactive, and thrives in a collaborative environment where mentorship and support for junior talent are core values.
The Compensation range for this role is 80,000 to 95,000 USD annually and may be eligible for an annual bonus.
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.Must be authorized to work in the United States for any employer.
Your specific salary will be determined based on several factors:
- Location-based market rate for the role
- Your abilities in relation to the job specification
- Performance during screening and interview
- Pay parity with the wider team in the considered location
Further details about the package will be provided during the initial screening call with the Talent Acquisition Team.Click [here](https://flimp.live/MyEpiqBenefits) to learn about Epiq's Benefits.
Epiq Leadership CompassFosters Relationships & Collaboration
Builds trust and alignment through open communication, shared goals, and strong partnerships to drive collective success.
- Build trust-based partnerships
- Nurture long-term relationships
- Remove collaboration barriers
- Celebrate cross-team success
Engages & InfluencesInspires action and alignment through clear communication, purposeful influence, and a compelling vision.
- Use storytelling to build buy-in
- Align communication with organizational goals
- Guild alignment through strong engagement
Maximizes PerformanceSets and reinforces performance standards that drive results, ensure accountability, and align with Epiq’s goals.
- Use data to identify improvement opportunities
- Align team goals with boarder strategy
- Empower teams to manage their own goals
- Translate vision into clear priorities
- Prepare for disruptions with strong change management
Achieves Operational SuccessDrives continuous improvement and operational excellence through smart processes, data insights, and quality execution.
- Improve workflows for team efficiency
- Use clear documentation and expectations
- Resolve issues quickly using data and feedback
It is Epiq’s policy to comply with all applicable equal employment opportunity laws by making all employment decisions without unlawful regard or consideration of any individual’s race, religion, ethnicity, color, sex, sexual orientation, gender identity or expressions, transgender status, sexual and other reproductive health decisions, marital status, age, national origin, genetic information, ancestry, citizenship, physical or mental disability, veteran or family status or any other basis protected by applicable national, federal, state, provincial or local law. Epiq’s policy prohibits unlawful discrimination based on any of these impermissible bases, as well as any bases or grounds protected by applicable law in each jurisdiction. In addition Epiq will take affirmative action for minorities, women, covered veterans and individuals with disabilities. If you need assistance or an accommodation during the application process because of a disability, it is available upon request. Epiq is pleased to provide such assistance and no applicant will be penalized as a result of such a request. Pursuant to relevant law, where applicable, Epiq will consider for employment qualified applicants with arrest and conviction records.
View this job on nocollar jobs