• Design, develop, and maintain end-to-end big data pipelines for enterprise applications
• Work on Apache Hadoop and Apache Spark-based data processing frameworks
• Manage and optimize data pipelines, scripts, and production systems for performance and stability
• Perform unit testing of data pipelines and support UAT (User Acceptance Testing) activities
• Debug and resolve issues in existing data pipelines, scripts, and production workflows
• Modify and enhance existing data processing systems based on business requirements
• Review design, code, and deliverables to ensure high-quality output
• Build and maintain scalable and secure big data solutions using cloud platforms
• Ensure implementation of data governance, security, and compliance standards
• Mentor junior team members and contribute to knowledge sharing initiatives
• Participate in Agile development practices and cross-team collaboration
• Handle Proof of Concepts (PoCs) and deliver solutions within timelines
