Senior Data Engineer
Tasks
- Build data models and ETL/ELT processes
- Develop APIs and data services
- Develop end to end data pipelines on Databricks
- Ensure data quality, integrity, and security
- Implement data governance, security, and compliance
- Implement data ingestion, transformation, and processing workflows
- Integrate data sources and systems
- Monitor troubleshoot and optimize pipeline performance
- Write modular and well documented code in Python Scala SQL and PySpark
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Avro | Azure Databricks | Azure DevOps | CI/CD | Data Compliance | Data Governance | Data Modeling | Data Security | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Git | JSON | Kafka | Parquet | PySpark | Python | SQL | Scala | Series data | Spark Streaming | Time Series | Time Series Data | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level Full TimeHyderabad, India2h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeChennai, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeAhmedabad, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Drift Detection | FastAPIAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeNew Delhi, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAPI Integration | AWS | Anthropic API | CD pipeline | CI/CDAnnual learning budget | Flexible hours | Learning opportunities | Mentorship | Performance reviewsSenior-level Full TimeHyderabad, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionFlexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportSenior-level Full TimeKolkata, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeIndore, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Drift Detection | FastAPIAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeJaipur, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic API | CI/CD | Cloud Security | Drift DetectionAnnual TechTalks | Flexible hours | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeJalalabad, India3h ago
-
Senior Security Software Engineer ID80139 JPY 8600K-11800KAPI Integration | AWS | Anthropic | CI/CD | FastAPIAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeKochi, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeCollaborative culture | Flexible hours | Learning budget | Mentorship | Performance reviewsSenior-level Full TimePune City, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Drift Detection | FastAPIFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMumbai, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeBangalore North, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeCoimbatore South, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIAnnual learning budget | Flexible hours | Local people focused support | Mentorship | Performance reviewsSenior-level Full TimeNoida, India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance reviewsSenior-level Full TimeGurgaon Kty., India3h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Learning support programs | Mentorship | Performance reviewsSenior-level Full TimeTrivandrum, India3h ago
-
AI/ML Engineer INR 3000K-5000KAccess Management | Agentic AI | Automated testing | CI/CD | Cloud ComputingSenior-level Full TimeChennai, Tamil Nadu, India4h ago
-
Senior Data Engineer INR 2000K-3000KAWS | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India R4h ago
-
DBA/Reliability and Automation Engineer INR 500K-1500KAnsible | Bash | CI/CD | CloudFormation | DatadogMid-level Full TimeIndia4h ago
-
Senior Data Engineer INR 3000K-4000KApache Airflow | Apache Spark | Azure | CI/CD | DatabricksEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India5h ago
-
Software Engineer, AI/ML, PhD, Early Career, 2026 INR 4000K-6000KC# | C++ | Data Mining | Data Processing | Data StorageSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon RedshiftSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeKarnataka, India6h ago
-
Voice AI Engineer (Hybrid) INR 1900K-3000KAPIs | CRM | Cloud Computing | Conversational AI | Conversational ContextCustomer implementation support | Hybrid work model | SaaS work experience | Startup cultureMid-level Full TimeMaharashtra, Mumbai, India6h ago