Senior Data Engineer
Tasks
- Architect event driven streaming systems
- Build operational and analytical storage patterns
- Define secure by default access patterns
- Design batch and streaming data pipelines
- Establish orchestration and operational excellence
- Implement data quality and governance controls
- Lead data warehouse and lakehouse design
- Maintain lineage and metadata practices
- Mentor engineers and run design reviews
- Own data platform architecture
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Airflow | Amazon Redshift | Apache Beam | Apache Flink | Apache Spark | Audit Logging | Automated testing | BigQuery | Bigtable | CI/CD | Capacity Planning | Cassandra | Cloud Data | Cloud Dataflow | Cloud data warehousing | Column-stores | Composer | Dagster | Data Governance | Data Lineage | Data Warehousing | Databricks | Dimensional Modeling | Google Cloud | Google Cloud Dataflow | HBase | Idempotency | Incident Response | Metadata Management | Observability | PII handling | Policy-as-Code | Prefect | Query Optimization | SLA | SLO | Schema evolution | Snowflake | Wide-column stores | “as-code”
Education
N/A
Roles
Related jobs
-
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000KApp Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India10h ago
-
CI/CD | Couchbase | Design Patterns | Docker | GuiceSenior-level Full TimeGurugram 8 B, India10h ago
-
Sr. Azure Data Engineer INR 1500K-2000KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN10h ago
-
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBhubaneswar - Ihub, India10h ago
-
Mid-level Full TimeBangalore, KA, IN, 56214910h ago
-
Technical Support Engineer INR 850K-1100KAmazon Web Services | Apache Hadoop | Apache Spark | Bash | Cloud platformFlexible paid time offMid-level Full TimeHyderabad, India16h ago
-
Software Engineer Lead (Python + Snowflake) INR 2040K-3100KAirflow | CI/CD | DBT | Dagster | Data ModelingSenior-level Full TimeIndia (Noida)17h ago
-
Principal Consultant-Manager, GenAI Engineer (Cloud: GCP) INR 2520K-3380KAgent Development | Agent Development Kit | Agent systems | Artificial Intelligence | Automated testingContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Hyderabad21h ago
-
Senior-level Full TimeIN-MH-Pune21h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 1960K-2600KA/B | A/B Testing | B testing | Clustering | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
Developer, Data Analytics INR 1200K-1968KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad21h ago
-
Senior Data Engineer INR 1300K-2000KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad21h ago
-
ALM | ASPICE | Anomaly Detection | Automation | CybersecuritySenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500KAWS | CI/CD | Databricks | ETL | PySparkSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Algorithms | Artificial Intelligence | Capacity Planning | Data center | Data center capacity planningSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Algorithms | Artificial Intelligence | BigQuery | Cloud Storage | Cloud platform24x7 support rotation | Non-standard hours | On-call workMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India23h ago
-
Agentic AI Developer INR 2500K-2800KAPI Development | AWS | Azure | Deep learning | Deployment PipelinesMid-level Full Timepune, Maharastra, India23h ago
-
Senior-level Full TimeBengaluru, Karnataka, India23h ago
-
Cloud Engineer INR 750K-1000KAWS Lambda | Access Control | Access Control List | Amazon Web Services | Apache TomcatEnhanced medical benefits | Family well-being benefits | Health Safety and Wellbeing | Paid time off | Wellbeing benefitsMid-level Full TimeHyderabad, India23h ago
-
Analytics Solution Senior Associate INR 2000K-3380KAWS Glue | AWS Lambda | Agile methodologies | Data Governance | Data IngestionContinuous improvement | Inclusive work environment | TeamworkSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Senior Data Engineer INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Alerting | Amazon EMRSenior-level Full TimeHyderabad, IN1d ago
-
Data Analytics - Power BI - ETL INR 1628K-2040KAzure Data | Azure Data Factory | DAX | Data Factory | Data ModelingSenior-level Full Time Part Timetelengana, India1d ago
-
Junior AI/ML Engineer – Data Engineer (Retail Intelligence) INR 1200K-1800KA I | A I Agent | A I Agent Frameworks | A/B | A/B TestingCross-functional collaboration | Hybrid work environment | MentorshipMid-level Full TimeBengaluru, Karnātaka, India1d ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeChennai, Tamil Nadu, India1d ago