Senior Data Engineer
Tasks
- Build CI CD pipelines for data deployments
- Collaborate with cross-functional teams
- Design and develop scalable ETL pipelines
- Ensure data security compliance and RBAC
- Implement data virtualization techniques
- Implement real-time and batch data processing
- Manage metadata and data lineage
- Optimize big data processing frameworks
- Optimize query performance indexing partitioning and caching
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS IAM | Agile | Apache Spark | CI/CD | Caching | Data Governance | Data Lineage | Data Modeling | Data fabric | Data mesh | Data virtualization | Databricks | ELT | ETL | Hadoop | Indexing | Jenkins | Metadata Management | Partitioning | PySpark | Python | Query Optimization | RBAC | SAFe | SQL | SparkSQL | Version control | Workflow Orchestration
Education
Roles
Related jobs
-
Senior-level Full TimePune City, India6h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India8h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India9h ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Applied AI ML Lead INR 2500K-4800KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Agentic AISenior-level Full TimeHyderabad, Telangana, India10h ago
-
Software Engineer (Backend Developer) INR 1500K-3500KAWS | Active Directory | Agile | Algorithms | Data StructuresMid-level Full TimeBangalore, India Office (BANGALORE) R11h ago
-
Agentic AI | Agile | DAX | Data Governance | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Lead Software Engineer - Java/Python, LLM, AWS INR 3000K-5000KA/B | A/B Testing | AWS | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Platform Engineering Professional - Data Engineer INR 2200K-3500KAWS | Amazon Kinesis | Apache NiFi | Apache Spark | CI/CDMid-level Full TimeBengaluru, IN, 56010311h ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India11h ago
-
Mid-level Full TimePune, Maharashtra, India12h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India13h ago
-
FastAPI | Flask | GIS | Git | MultiprocessingMid-level Full TimeNoida, Uttar Pradesh, India14h ago
-
SDET- India (Chennai/Bangalore) INR 1500K-2000KAWS S3 | Apache Airflow | Apache Superset | BDD | Big DataMid-level Full TimeIndia14h ago
-
Amazon Web Services | Cloud platform | Data Modeling | Databricks | Distributed SystemsBroadband reimbursement | Continuous learning support | Global enterprise client exposure | Health insurance | Paid certificationsSenior-level Full TimeIndia14h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Entrepreneurial-minded team | Friendly relaxed atmosphere | Remote/distributed workMid-level Full TimeBangalore, India15h ago
-
Analytics Engineer - Associate INR 1800K-2800KAirflow | Alerting | Azure Data | Azure Data Factory | DagsterSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Competitive compensation | Flexible management | Friendly atmosphereMid-level Full TimeMumbai, India15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeNoida, India15h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Friendly work environment | Impactful product | Professional development opportunitiesMid-level Full TimeAhmedabad, India15h ago
-
Software Engineer III - AI/ML, Prompt Engineer INR 2475K-4132KA/B | A/B Testing | API Integration | B testing | Chain-of-ThoughtSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Sr SW Engineer, Machine Learning INR 2475K-3380KA/B Testing | Airflow | Amazon EMR | Amazon S3 | Apache KafkaCommuter benefits | Disability insurance | Financial wellness support | Healthcare (Medical Dental Vision) | Hybrid work scheduleSenior-level Full TimeBengaluru, India16h ago