IN_Senior Associate_AWS Data Engineer_D&A_Advisory_Bangalore
Bengaluru Millenia, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply data security governance and access control
- Build batch and near real time ingestion pipelines
- Collaborate in Agile/Scrum
- Create technical documentation
- Design data pipelines
- Develop ETL/ELT workflows
- Develop Python PySpark data transformations
- Implement Snowflake SnowPipe Streams Tasks
- Implement Snowflake data warehouse solutions
- Ingest data from APIs databases and files
- Optimize Snowflake performance and cost
- Orchestrate pipelines with Apache Airflow
- Run data quality checks and monitoring
- Troubleshoot pipeline failures and incidents
- Use Git and CI CD for source control testing and deployment
- Write complex SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Athena | AWS EMR | AWS Glue | AWS Lambda | AWS Redshift | AWS S3 | Apache Airflow | Batch Ingestion | CI/CD | Data Modeling | Data Quality | Data Warehousing | Dimensional Modeling | ELT | ETL | File Formats | Git | IAM | Near-real-time | Near-real-time ingestion | PySpark | Python | Real-time Ingestion | SQL | Snowflake | Snowflake File Formats | Snowflake Stages | Snowflake Streams | Snowflake Tasks | Snowpipe | Spark
Education
Roles
Related jobs
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India9h ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India17h ago
-
Senior AI/ML Engineer INR 3799K-5572KAI Security | AI Services | AWS | Agentic AI | AirflowAccident Coverage | Career growth | Group term life insurance | Health insurance | Hybrid work supportSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R18h ago
-
AIML Engineer Digital & AI INR 3242K-5000KAWS | Azure | CI/CD | Deep learning | DockerAccident Coverage | Career growth | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R18h ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India18h ago
-
Computational Software Specialist (Turbomachinery R&D Team) INR 1753K-2700K.NET | Application Architecture | C# | Debugging | GitInternational and multidisciplinary working environment | Long-term career development opportunities | Supportive team culture focused on quality innovation and continuous improvementSenior-level Full TimeGurugram - Haryana - India18h ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India18h ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India18h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Sr.Data Engineering INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India19h ago
-
DevOps/MLOps Specialist INR 4000K-5500KAnsible | Apache Airflow | Apache Beam | Apache Kafka | CI/CDMid-level Full Timebengaluru, India19h ago
-
Senior-level Full TimePune, Maharashtra, India19h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India19h ago
-
Lead Developer (Python, React, AWS, GenAI) INR 3242K-4800KAgile | Amazon Web Services | Apache Kafka | Continuous integration | DevSecOpsAutonomy | Inclusive & Supportive Culture | Mentoring | Professional development opportunitiesSenior-level Full TimePune, India20h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R21h ago
-
C# | C++ | Data Science | Data Structures | Distributed SystemsExecutive-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India21h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R21h ago
-
Applied AI/ML Engineer INR 2000K-3000KAgentic Systems | Bias Mitigation | Decision Trees | Evaluation Frameworks | Fallback mechanismsMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R21h ago