Senior Data Engineer
Pune IN (Office: 5th & 6th floors) (0D03), India
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Build batch pipelines
- Build streaming pipelines
- Collaborate with analytics teams
- Design data pipelines
- Develop data pipelines
- Gather requirements
- Implement Databricks Jobs
- Implement Databricks SQL
- Implement Databricks workflows
- Implement Delta Lake Medallion architecture
- Implement data governance best practices
- Implement data quality controls
- Implement data security controls
- Ingest data from APIs
- Ingest data from SAP
- Ingest data from databases
- Mentor junior engineers
- Migrate aws workloads to databricks
- Optimize Spark workloads
- Optimize data pipelines
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | CI/CD | DBT | Databricks | Databricks Jobs | Databricks Workflows | Delta Lake | DevOps | Glue | PySpark | Python | Redshift | SQL | Structured Streaming | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Design Verification Engineer, PhD, Early Career INR 2500K-6000KAI | AI accelerators | Accelerator architectures | Arithmetic Unit | Bus architectureNone Full TimeBengaluru, Karnataka, India2h ago
-
Software Engineer III - Tableau SRE & Automation INR 2500K-4000KChange Management | DNS | Dynatrace | Firewall | GrafanaSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Senior-level Full TimeHyderabad, IN5h ago
-
Mid-level Full TimeHyderabad, TS, India6h ago
-
Lead / Manager Agentic AI Engineer - Claude Code & Codex INR 2000K-4500KAWS | Asynchronous programming | Autogen | Azure | CI/CDSenior-level Full TimeHyderabad, TS, India6h ago
-
Data Engineer INR 1500K-2200KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN6h ago
-
Senior Data Engineer INR 1500K-2600KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageSenior-level Full TimeHyderabad, IN6h ago
-
Senior-level Full TimeGurgaon, HR, India7h ago
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 5601007h ago
-
(Senior) Software Engineer (all genders) 1 INR 3600K-4720KAI Safety | AWS | Amazon Web Services | Apache Spark | Automated testingSenior-level Full TimeBangalore, Karnataka, IN, 5601007h ago
-
AI Engineer (India, China) INR 2500K-4064KAPIs | AWS | Airflow | Apache Spark | AutogenAnnual leave | Flexible working | Life insurance | Medical insurance | Parental leaveMid-level Full TimeBangalore, IN8h ago
-
Mid-level Full TimeIndia - Bengaluru9h ago
-
Adversarial Training | Arize | Audio Processing | Automatic Speech Recognition | Dataset SynthesisChai or coffee | ESOP | Flexible work environment | Free lunch | Workspace perksEntry-level Full TimeNew Delhi, India10h ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R10h ago
-
Senior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN12h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R14h ago
-
API Testing | AWS | Azure | BLEU | Bias TestingOnsite workSenior-level Full TimeBengaluru, India14h ago
-
Senior-level Full TimeChennai, Chennai-MRV-AD, IN14h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …14h ago
-
Sr Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …14h ago
-
Sr Technical Lead-BI INR 1500K-2700KBI Data modeling | DAX | Data Modeling | Data Warehousing | Dimensional ModelingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …14h ago
-
AI / ML Engineer INR 2000K-5000KAI Services | Chatbots | Cloud AI | Cloud AI services | Deep learningSenior-level Full TimeChennai, CDC2A, India14h ago
-
Senior-level Full TimeBengaluru, BDC7C, India14h ago
-
Data Platform Engineer INR 1000K-2000KAI Services | AWS AI | AWS AI Services | Cloud-based | Cloud-based DataMid-level Full TimeBengaluru, BDC6F, India14h ago
-
Mid-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …14h ago