IN_Senior Associate_ AWS Data Engineer_Data and Analytics_Advisory_Bangalore
INR 1500K-2600K (estimate) Senior-level Full Time
Tasks
- Build data transformation jobs with Python and PySpark
- Collaborate with teams in Agile/Scrum
- Create technical documentation
- Design scalable data pipelines
- Develop ETL/ELT workflows
- Develop Snowflake data warehouse solutions
- Enforce data security governance and access control
- Implement Snowflake Snowpipe Streams Tasks and stages
- Implement Snowflake performance optimization
- Implement data quality checks and monitoring
- Ingest data from APIs databases and files
- Orchestrate pipelines with Apache Airflow
- Troubleshoot pipeline failures and performance issues
- Use Git for source control and CI CD deployments
- Write complex SQL for data transformations
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon Athena | Amazon EMR | Amazon Redshift | Apache Airflow | CI/CD | CTAs | CTE | Clustering | DAG | DAG scheduling | DBT | Data Ingestion | Data Modeling | Data Quality | Data Sharing | Data Warehousing | Data loading | Dimensional Modeling | Docker | Dynamic Tables | ELT | ETL | Efficient Data Loading | Git | GitHub Actions | Great Expectations | Infrastructure as Code | Kafka | Kinesis | Kubernetes | Monitoring | Near Real Time Data Ingestion | Near-Real-Time data | Near-real-time | Partitioning | PySpark | Python | Query Optimization | Real-time data ingestion | Reconciliation | S3 | SQL | Secure Data | Secure Data Sharing | Snowflake | Snowflake Dynamic Tables | Snowflake Stages | Snowflake Streams | Snowflake Tasks | Snowflake Time Travel | Snowpipe | Spark | Step Functions | Stored Procedures | Terraform | Time Travel | Views | Warehouse optimization | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level ContractShaikpet, India3h ago
-
Senior-level Full TimeHyderabad, India4h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamCareer growth opportunities | Complimentary games | Family Leaves | Healthcare coverage | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India5h ago
-
Advanced Engineer-AI/ML INR 2500K-4680KAI orchestration | API Integration | ASR | AWS | Action modelsEmployee discounts | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …6h ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-5000KC plus plus | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Principal Silicon Engineer - Storage INR 1163K-3500KAmazon S3 | Azure Blob | Azure Blob Storage | Azure Files | Backup and RecoverySenior-level Full TimeIndia8h ago
-
Lead Software Engineer Java INR 3000K-4500KAI code assistants | AWS | Agile | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Informatica / Data warehousing Engineer INR 2700K-4000KAgile | BigQuery | Dashboard Design | Dashboard Development | Data GovernanceSenior-level Full TimeIndia8h ago
-
Informatica / Data warehousing Engineer INR 2771K-4000KAccess Controls | Agile | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeIndia8h ago
-
AI/ML Engineer INR 2000K-3500KAzure | Data Pretraining | Data Structures | DeepSpeed | Distributed SystemsCar lease benefits | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSMid-level Full TimeBangalore, Karnataka, India R8h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure | Azure Databricks | Azure DevOps | CI/CD | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India9h ago
-
Senior-level Full TimeHyderabad, Telangana, India9h ago
-
Advanced Robotics Simulation Engineer INR 2000K-4680KDocker | GPU Computing | Isaac Lab | Isaac Sim | Isaac-GymSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure | Azure AppCertification programs | Corporate NPS | Dental insurance | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R10h ago
-
Senior-level Full TimeHyderabad, TS, India10h ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R10h ago
-
Data Protection Lead Engineer INR 1500K-3000KArtificial Intelligence | Azure | Cloud platform | DLP | Data ClassificationSenior-level Full TimeIndia10h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India10h ago
-
SO_Cloud_Devops_Engineer_SME_2026 INR 400K-500KAzure Data | Azure Data Factory | CI/CD | Command Line | Command-line scriptingEntry-level Full Timepune, India11h ago
-
Analyst, Business Intelligence INR 3000K-5000KAWS | Azure | Azure OpenAI | CI/CD | Distributed SystemsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India11h ago
-
Data Transformation and Management Specialist INR 1500K-3000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India12h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeEntrepreneurial team | Fast-growing environment | Flexible asynchronous culture | Remote/distributed workMid-level Full TimeBangalore, India12h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible remote setting | Friendly laid-back atmosphere | Opportunity for high impactMid-level Full TimeDelhi, India12h ago
-
Sr Data Engineer INR 3000K-4000KAPIs | Airflow | Apache Iceberg | CI/CD | Control-MAnnual leave | Development courses | Employee assistance program | Flexible working options | Life insuranceSenior-level Full TimeBangalore, IN13h ago
-
Senior-level Full TimeBengaluru, Karnataka, India13h ago