Lead Data Engineer / Developer (Python) - Manager
Tasks
- Automate ETL workflows
- Build CI/CD pipelines
- Build data enrichment logic
- Create end to end data gathering and analysis pipelines
- Detect data anomalies
- Develop and implement Python data models
- Implement data monitoring heuristics
- Implement financial models in Python
- Optimize repetitive and computationally intensive tasks
- Perform root cause analysis for production issues
- Perform time series data analysis
- Write technical documentation
Perks/Benefits
- Employee networks
- Flexible work/life support
- Hybrid work
- Inclusive development opportunities
- Paid volunteer days
- Vibrant team culture
Skills/Tech-stack
AWS | Airflow | Autosys | Azure | CI/CD | Cause analysis | Data Enrichment | Data Quality | Databricks | ETL | GitHub | Jira | Matplotlib | Multiprocessing | Multithreading | NumPy | PLSQL | Pandas | PostgreSQL | Python | Root Cause Analysis | Root cause | SQL | Scikit-learn | Series analysis | Threading limitations | Time Series | Time Series Analysis
Related jobs
-
API Security | Application Security | Automation | Bash | CI/CDMid-level ContractHyderabad, India3h ago
-
Mid-level Full TimeIN-MH-Mumbai4h ago
-
Pyspark Developer INR 800K-1500KData Modeling | Dimensional Modeling | PySpark | Relational databases | SQLMid-level Full TimeIN-TN-Chennai4h ago
-
AWS Data Engineer- Airflow INR 1500K-2400KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopSenior-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAWS | Airflow | Amazon SageMaker | Apache Airflow | Apache SparkAccess to cutting-edge technologies | Collaborative work environment | In office 5 days per week | Professional development | Training and education opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …4h ago
-
MS Fabric / Azure Data Engineer ( 5- 7 yrs ) - Immediate Joiners INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data ArchitectureImmediate JoinersSenior-level Full TimeBengaluru, KA, India5h ago
-
Staff Software Engineer, Analytics INR 2520K-4000KAlgorithms | Analysis and Design | Big Data | C++ | Data IngestionSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1500K-2500KAPIs | Agent systems | Cloud platform | Data Pipelines | Google CloudMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-2500KAPIs | Agent systems | Cloud platform | CrewAI | Data EngineeringMid-level Full TimeMumbai, Maharashtra, India; Gurgaon, Haryana, India6h ago
-
None Full TimeNoida, Uttar Pradesh, India6h ago
-
None Full TimeNoida, Uttar Pradesh, India6h ago
-
None Full TimeIndia7h ago
-
AI Software Engineer III - Platform INR 2000K-4000KAPI Gateway | APIs | AWS EC2 | AWS Lambda | Amazon APISenior-level Full TimeHyderabad, Telangana, India7h ago
-
Data Science Analytics (P&C Insurance Domain) INR 4000K-4000KAWS | Agile | Artificial Intelligence | Azure Data | Azure Data BricksExecutive-level Full TimeBangalore, KA, India8h ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeIndia9h ago
-
Mid-level Full TimeBengaluru, Karnataka, India9h ago
-
Associate Process Manager INR 800K-1500KAWS | Apache Airflow | Apache Hadoop | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India9h ago
-
Website Analytics Architect INR 2520K-3880KA/B | A/B Testing | AEMaaCS | Adobe Analytics | Adobe ExperienceSenior-level Full TimeBangalore, Karnataka, IN, 56010010h ago
-
Agile | Amazon Redshift | Batch Processing | BigQuery | CI PipelineCollaborative global work environment | Cross-functional collaboration | Flexible working arrangements | Fully remote friendly | Inclusive cultureSenior-level Full TimeIndia R11h ago
-
Data Engineer INR 1753K-2250KAPI | Agile | Azure Automation | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
API | Batch Processing | Data Compliance | Data Governance | Data ModelingContinuous learning | Flexible work hours | Health and wellness support | Inclusive work culture | Paid time offSenior-level Full TimeIndia11h ago
-
AI Senior Software Engineer INR 2000K-4000KAI Search | AI gateway | AI gateway patterns | API Design | AWS BedrockSenior-level Full TimeBengaluru, India11h ago
-
Senior System Administrator II [Storage Engineer] INR 1000K-1890KAWS EBS | AWS S3 | Ansible | Ceph | DASMid-level Full TimeBengaluru12h ago
-
Sr.Research Engineer - Applied AI/ML INR 2000K-4170KAPI Design | Algorithms | Apache Spark | Conversational AI | Data AnalysisSenior-level Full TimeGurugram, India13h ago