Senior Data Engineer - Full Stack (US, Remote)
Maharashtra, Pune, India
R
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Automate Databricks jobs deployment and scheduling
- Build and maintain automation tools and scripts
- Build internal dashboards and tools
- Demonstrate model inference capabilities
- Design and develop CLI tools
- Develop testing frameworks for pipelines
- Execute integration testing
- Implement MLOps workflows with APIs
- Implement data governance workflows
- Monitor data pipeline productivity
- Orchestrate data pipelines
- Perform environment setup and configuration
- Provide configuration and operational controls
- Provision environments
- Synchronize metadata
- Test and validate ML inference workflows
- Validate ETL ELT workflows
- Visualize data pipelines and workflows
Perks/Benefits
Skills/Tech-stack
API | AWS | CI/CD | CLI | Data Governance | Databricks | Databricks SDK | ELT | ETL | End to End | End-to-End Testing | Integration Testing | MLOps | Metadata Management | Python | React | Spec Driven Development | Streamlit | Terraform | Testing | Version control
Education
N/A
Roles
Related jobs
-
AI Engineer, (Full Stack Development) INR 1800K-3000KAPI Integration | AWS | Anthropic | Authentication | Cloud FunctionsMid-level Full TimeMumbai, Maharashtra, India - Remote R18h ago
-
Sr. Analytics Engineer - Data Warehouse (Hybrid, Bangalore) INR 2515K-3500KAWS | Airflow | Amazon EC2 | Amazon S3 | AmplitudeCareer growth opportunities | Hybrid work | MentorshipSenior-level Full TimeBangalore, INDIA R19h ago
-
Senior Lead, Support INR 2000K-4800KAI Foundry | Amazon Bedrock | Anthropic Claude | Authentication | AuthorizationSenior-level Full TimeRemote Working, India R20h ago
-
Ansible | CAP Theorem | CI/CD | ClickHouse | Consensus ProtocolsHealth & wellness support | High ownership autonomy | Mentorship learning environment | Professional development support | Remote-first cultureSenior-level Full TimeIndia R1d ago
-
Senior Full-Stack AI Engineer- 3185 (Remote) INR 2000K-4500KAI Foundry | AWS Bedrock | Agile | Anthropic | Azure AIFlexible working hours | Learning and development programs | Recognition rewards | Remote workSenior-level Full TimeChennai, India R1d ago
-
Full-Stack AI Engineer - 3184 (Remote) INR 2000K-4500K.NET | AI Foundry | Agile | Azure AI | Azure AI FoundryFlexible working hours | L and D programs | Professional development | Remote work | Rewards and recognitionSenior-level Full TimeChennai, India R1d ago
-
Data Platform Engineer/Consultant Specialist INR 1500K-2500KAmazon S3 | Ansible | Atlassian Confluence | Atlassian Jira | AutomationFlexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
AWS | Agile | Amazon Web Services | Authentication | AuthorizationFlexible working | Inclusive work culture | Opportunities for growth | Professional developmentMid-level Full TimeHyderabad, Telangana, India R1d ago
-
CLIP | Deep learning | Diffusers | Diffusion Models | Fine TuningAnnual vacation | Corporate discounts | Fully remote | Health allowance | Home office reimbursementSenior-level Full TimeIndia R1d ago
-
Senior Gcp Data Engineer/Senior Consultant Specialist INR 1500K-2500KAccess Control | Apache Airflow | Apache Kafka | Apache NiFi | Audit LoggingSenior-level Full TimePune, Maharashtra, India R1d ago
-
AI alignment | Agent Frameworks | Chat orchestration | Direct Preference Optimization | Distributed TrainingConference support | Fully remote | Health support budget | Home office stipend | Language learning discountsSenior-level Full TimeIndia R1d ago
-
Senior Software Engineer INR 2800K-4000KAI | Access Control | Airflow | Artificial Intelligence | AstronomerSenior-level Full TimePune, India R1d ago
-
AI Data Engineer INR 2500K-3380KAPI | AWS | Agile | DBT | Data EnrichmentEmployee incentive programs | Flex my way policies | Headspace app access | Hybrid work model | Mental health daysMid-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Staff Enterprise AI Engineer - Agentic Workflows & Productivity INR 3000K-5000KAPI Integration | CI/CD | Confluence | Cost Optimization | Data PrivacyFlexible work schedule | Hybrid workSenior-level Full TimeBangalore, India R1d ago
-
Senior Software Engineer (Machine Learning) INR 3000K-6000KAutomated testing | CI/CD | Language Models | Large Language Models | Machine LearningSenior-level Full TimeRemote - Sahibzada Ajit Singh Nagar, … R1d ago
-
Data Quality Governance and Strategy Associate Engineer INR 2000K-3000KAI | Collibra | Data Controls | Data Governance | Data LineageFlexible hybrid model | Health insurance | Life insurance | Paid time off | Personal/family careMid-level Full TimeHyderabad, India R2d ago
-
Sr Principal Data Scientist INR 3000K-4000KAgentic AI | Causal Inference | Causal ML | Contextual Bandits | DatabricksSenior-level Full TimeBangalore, INDIA R2d ago
-
Machine Learning Engineer INR 1800K-3000KAWS SageMaker | Albumentations | Audio classification | Azure Machine Learning | CI/CDLeadership development programs | Learning and development programs | Multicultural experience | Open minded collaborative culture | Professional growthMid-level Full TimeIndia R2d ago
-
Machine Learning Engineer INR 1800K-3000KAWS SageMaker | Albumentations | Audio classification | Azure Machine Learning | CI/CDCollaborative culture | Learning and development programs | Multicultural team | Professional growthMid-level Full TimeIndia R2d ago
-
Machine Learning Engineer (Remote) INR 2500K-4500KAutomated testing | CI/CD | Git | Machine Learning | NumPyRemote work | Scrum team collaborationSenior-level Full TimeMaharashtra, Pune, India R2d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-2500KAgent Orchestration | Agent systems | Amazon Web Services | Cloud platform | ComplianceFlexible workingMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior-level Full TimeKarnataka, India R2d ago
-
Lead Data Engineer INR 2000K-3000KAWS | Amazon S3 | Apache Airflow | Apache Kafka | Apache NiFiBroadband reimbursement | Medical insurance | Paid certifications | Personal accident insurance | Professional development allowanceSenior-level Full TimeIndia - Remote R2d ago
-
Agentic AI | Airflow | Apache Kafka | Audit compliance | BigQueryMid-level Full TimeHyderabad, Telangana, India R2d ago
-
AI Engineer(Remote, IND) INR 2475K-5000KAWS Bedrock | CI/CD | DAST | DevSecOps | DockerCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks and volunteer opportunities | Great Place to Work certified | Paid parental and adoption leavesSenior-level Full TimeIND MH Remote, India R2d ago