Lead Software Engineer
Tasks
- Architect end-to-end data solutions
- Assess data orchestration and ETL workflows
- Create data lineage and source to target mappings
- Deploy and manage AWS based data solutions
- Design data collection storage modelling and consumption
- Design data intensive applications with APIs and streaming pipelines
- Develop ER modelling and dimensional modelling
- Drive cloud innovation
- Ensure data security, compliance, and governance
- Establish coding standards and technical documentation
- Evaluate and recommend data technologies
- Guide database and data warehouse transfers between data tiers
- Implement batch and real-time data pipelines
- Implement data quality controls and monitoring
- Mentor junior data engineers
- Migrate on premises applications to cloud PaaS
- Optimize data models for performance
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | AWS | Airflow | Apache Spark | Azure | Batch Processing | BigQuery | CI/CD | Cassandra | Cloud Migration | CloudFormation | DBT | Data Factory | Data Governance | Data Lakehouse | Data Lineage | Data Pipelines | Data Quality | Data Security | Data Warehousing | Data fabric | Data mesh | Database Migration | Database Migration Service | Databricks | Datadog | Dataflow | Dataproc | Dimensional Modelling | Docker | DynamoDB | EC2 | ELT | ER Modelling | ETL | Fabric | GCP | Git | GitHub Actions | GitLab CI | Glue | Grafana | Hadoop | Hive | InfluxDB | Informatica | Java | Jenkins | Kafka | Kubernetes | Lambda | Luigi | Microservices Architecture | MongoDB | MySQL | NoSQL | Oracle | PostgreSQL | Python | RDS | Real Time | Real-time Data | Real-time data pipelines | Redshift | S3 | SQL | SQL Server | Scala | Server Migration | Server Migration Service | Snowflake | Streaming | Synapse | Talend | Terraform | Time Series | Time-series databases | TimescaleDB | UML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Apache Spark | Caching | Data Quality | Data Validation | DataFrameSenior-level ContractSeri Lingampally, India4h ago
-
Data Engineer - Solution Expert INR 1500K-2700KBigQuery | CI/CD | Cloud Security | Cloud platform | Data ModelingSenior-level Full TimePune, MH, India5h ago
-
Generative AI Application Developers INR 1800K-4500KC++ | Computer Vision | Debugging | Generative AI | JavaSenior-level Full TimePune, Maharashtra, India6h ago
-
Generative AI Application Developers INR 1500K-2500KAI integration | Deep learning | Generative AI | Language Processing | Machine LearningMid-level Full TimePune, Maharashtra, India6h ago
-
Senior-level Full TimeMumbai, India6h ago
-
Senior-level Full TimeMumbai, India6h ago
-
Sr IT Analyst INR 2400K-4200KCRM | Data Governance | Data Quality | Data Warehouse | Data analyticsSenior-level Full TimePune, Maharashtra, India6h ago
-
Design Verification Engineer, PhD, Early Career INR 2500K-6000KAI | AI accelerators | Accelerator architectures | Arithmetic Unit | Bus architectureNone Full TimeBengaluru, Karnataka, India6h ago
-
Module Lead AI/ML INR 2500K-5000KAWS | Apache Airflow | Autogen | Azure | Cloud deploymentInclusive workplaceSenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Senior-level Full TimeBengaluru, Karnataka, India8h ago
-
Data Engineer INR 1500K-2500KAPI Integration | Access Control | Apache Airflow | Astronomer | BigQuerySenior-level Full TimeIndia8h ago
-
Software Engineer III - Tableau SRE & Automation INR 2500K-4000KChange Management | DNS | Dynatrace | Firewall | GrafanaSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior-level Full TimeHyderabad, IN9h ago
-
Mid-level Full TimeHyderabad, TS, India10h ago
-
Lead / Manager Agentic AI Engineer - Claude Code & Codex INR 2000K-4500KAWS | Asynchronous programming | Autogen | Azure | CI/CDSenior-level Full TimeHyderabad, TS, India10h ago
-
Data Engineer INR 1500K-2200KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN10h ago
-
Senior Data Engineer INR 1500K-2600KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageSenior-level Full TimeHyderabad, IN10h ago
-
Lead Data Scientist INR 2771K-4064KAzure | Bias reduction | Bitbucket | Cloud Computing | Data AggregationEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India10h ago
-
Senior-level Full TimeGurgaon, HR, India11h ago
-
Assistant Manager INR 1000K-1800KDashboarding | Data Analysis | Data Visualization | Power BI | SQLMid-level Full TimeGurugram, Haryana, India11h ago
-
Software Engineer II INR 1500K-4000KBest practices | C# | Data Pipelines | Debugging | Distributed SystemsMid-level Full TimeIndia, Karnataka, Bangalore11h ago
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 56010011h ago
-
(Senior) Software Engineer (all genders) 1 INR 3600K-4720KAI Safety | AWS | Amazon Web Services | Apache Spark | Automated testingSenior-level Full TimeBangalore, Karnataka, IN, 56010011h ago
-
Software Engr II INR 2500K-4800KAlerting | Azure Data | Azure Data Lake | Azure IoT | Azure IoT EdgeSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Director, Data Engineering & Analytics INR 1500K-6000KApache Airflow | Apache Kafka | Apache Spark | Business Intelligence | DBTOffice first model | Onsite collaborationExecutive-level Full TimeBengaluru, Karnataka, India11h ago