Prompt Engineer - Python/LLM

Job Description : We are seeking a talented and passionate Prompt Engineer to join our growing team. In this role, you will be at the forefront of leveraging Large Language Models (LLMs) to build cutting-edge applications. You will design, develop, and optimize production-grade prompts, create complex prompt chains and workflows, and rigorously evaluate and refine LLM outputs. Your expertise will be crucial in unlocking the full potential of LLMs for a variety of use cases. What You'll Do : - Design, develop, and optimize production-grade prompts for various LLMs (GPT, Claude, LLaMA, etc. - Craft prompts for diverse applications, including retrieval, generation, classification, and more. - Develop and maintain a library of effective prompts and prompt templates. - Build and refine complex prompt chains and workflows using LangChain and LangGraph. - Orchestrate LLM interactions to achieve specific application goals. - Design and implement robust and scalable prompt-based systems. - Conduct A/B testing to evaluate and compare prompt performance. - Implement metrics and methodologies for evaluating LLM output quality. - Perform performance tuning and optimization of LLM outputs. - Continuously experiment and iterate on prompts to improve accuracy, relevance, and efficiency. - Develop a deep understanding of LLM capabilities, constraints, biases, and hallucinations. - Implement strategies to mitigate LLM limitations and improve reliability. - Stay up to date with the newest advances in LLM technologies. - Write clean, efficient, and maintainable Python code for prompt engineering tasks. - Develop tools and scripts to automate prompt generation, evaluation, and deployment. - Work in production environments and ensure code quality and reliability. What We're Looking For : - 2-5 years of hands-on experience in prompt engineering and LLM fine-tuning. - Proven track record of designing and optimizing prompts for production applications. - Strong knowledge of various LLMs (GPT, Claude, LLaMA, etc.) and their behavior. - Understanding of LLM architectures, training processes, and capabilities. - Strong Python coding skills and experience working in production environments. - Experience with libraries such as LangChain and LangGraph. - Understanding of LLM constraints, biases, and hallucinations, and strategies to mitigate them. - Ability to identify and address potential issues related to LLM output quality. - Strong analytical and problem-solving skills, with the ability to evaluate and optimize LLM performance. - Ability to design and conduct experiments to test prompt effectiveness. - Excellent communication and collaboration skills, with the ability to work effectively in a team environment. - Ability to clearly communicate complex technical concepts. - Experience with cloud platforms (e.g. , AWS, Azure, GCP). - Knowledge of natural language processing (NLP) techniques. - Experience with data analysis and visualization tools. - Experience with other LLM frameworks. - Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Linguistics, or a related field (ref:hirist.tech)

Location: mumbai, IN

Posted Date: 5/1/2025