Java Software Engineer (ML & LLM Integration)
- Randomtrees
- 4 - 9 years
- Chennai
- 22 days ago
- Email to a friend
- Report this job
Job Description
We are seeking a highly skilled Senior Java Software Engineer with strong practical experience in both Traditional Machine Learning (ML) and Generative AI / Large Language Model (LLM) integration. In this role, you will bridge the gap between enterprise-grade, backend Java systems and advanced AI capabilities. You will design and deploy scalable production-ready pipelines that encompass classic ML strategies (predictive modeling, classification, regression) alongside state-of-the-art GenAI architectures like Retrieval-Augmented Generation (RAG) and autonomous agentic workflows.
Key Responsibilities
- AI/ML Backend Engineering: Design, build, and maintain high-performance backend microservices using Java (Spring Boot / Quarkus) that natively execute or orchestrate ML models and LLMs.
- LLM Orchestration: Develop intelligent application features utilizing frameworks like LangChain4j or Spring AI to handle dynamic prompt formatting, multi-modal context engineering, and model inference.
- Machine Learning Operations (MLOps) in Java: Load, serve, and run inference on classical ML and deep learning models natively using frameworks like TensorFlow Java, DeepLearning4j (DL4J), Tribuo, or ONNX Runtime.
- Data & Vector Engineering: Build robust data ingestion, chunking, and tokenization ETL pipelines. Implement high-accuracy RAG / GraphRAG workflows utilizing vector databases (e.g., Milvus, Pinecone, pgvector).
- Agentic Workflows: Implement autonomous AI agents capable of tool/skill execution, complex reasoning, and integrating local machine learning classifiers for real-time routing and validation.
- Performance & Optimization: Optimize low-latency inference boundaries in Java, managing heavy tensor allocations, multi-threading for non-deterministic model calls, and cost-aware rate limiting.
- Modern Development Practices: Actively utilize AI coding assistants (e.g., GitHub Copilot, Claude Code) to accelerate secure development, unit testing (JUnit 5, Mockito), and comprehensive code reviews.
Required Technical Skills & Qualifications
- Core & Frameworks: 5+ years of robust hands-on experience in Java (Java 17 or higher) and deep familiarity with Spring Boot or Quarkus.
- GenAI & LLM Integration: 12+ years of experience building applications powered by foundational models (OpenAI, Anthropic, Gemini, or open-source models like Llama via Ollama/HuggingFace).
- AI/ML Tooling: Solid understanding of LangChain4j or Spring AI for generative features, and exposure to Java ML libraries (e.g., Tribuo for regression/classification, DeepLearning4j, or TensorFlow SavedModelBundle wrappers).
- Data & Vectors: Strong database foundation (SQL/NoSQL) along with hands-on experience using Vector Databases for semantic search and metadata filtering.
- Cloud & Infrastructure: Experience deploying and operating cloud-native distributed systems on AWS, Azure, or Google Cloud, utilizing Docker, Kubernetes, and managed AI services (like Vertex AI or AWS Bedrock).
- Software Engineering Foundations: Mastery of microservices architecture, RESTful APIs, and asynchronous integration patterns (Kafka/RabbitMQ).
Preferred Qualifications
- Proficiency in Python (FastAPI, Scikit-learn, PyTorch) to easily collaborate with Data Science teams and successfully port/wrap prototype models into production Java systems.
- Familiarity with the Model Context Protocol (MCP) for building secure enterprise tools for AI agents.
- Understanding of NLP/ML fundamentals (embeddings, neural networks, tokenization, and evaluation metrics).
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Full Stack Data ScientistEmployement Type: Full timeContact Details:
Company: RandomtreesLocation(s): Chennai
Keyskills: Java Generative Ai LLM Machine Learning Python Spring Boot Microservices
Randomtrees
Delhivery is India\'s leading supply chain services company.\n\nThe company provides a full suite of logistics services such as express parcel transportation, LTL and FTL freight, reverse logistics, cross-border, B2B & B2C warehousing and technology services.\n\nOur vision is to become the opera...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in