Senior Data Engineer
Tasks
- Build and maintain Amazon QuickSight dashboards
- Create QuickSight datasets using Athena queries
- Design build and maintain AWS Glue ETL pipelines
- Develop and optimize AWS Step Functions orchestration
- Follow Git branching and CI CD practices
- Implement incremental loading and schema evolution
- Integrate EventBridge SQS SNS Athena and CloudWatch
- Manage Apache Iceberg tables on S3
- Monitor data freshness and pipeline health
- Optimize QuickSight performance with SPICE and Direct Query
- Optimize pipeline performance and costs
- Own BI delivery lifecycle
- Participate in code reviews and sprint planning
- Perform data quality checks
- Translate Tableau or Excel reports into QuickSight visuals
- Troubleshoot production pipeline failures
Perks/Benefits
Skills/Tech-stack
AWS CDK | AWS Glue | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon QuickSight | Amazon S3 | Amazon SNS | Amazon SQS | Apache Hudi | Apache Iceberg | CI/CD | CloudFormation | Data Modeling | Data Quality | Data orchestration | Delta Lake | Dimensional Modeling | EventBridge | GitHub Actions | IAM | Incremental loading | PySpark | Python | REST APIs | SQL | Schema evolution | Slowly Changing Dimensions | Step Functions | Tableau | Terraform
Education
N/A
Roles
Analyst | BI Analyst | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Data Analyst / ETL Dev INR 1500K-2300KAlteryx | Data Cleansing | Data Transformation | Data Validation | ETLMid-level Full TimeShaikpet, India1h ago
-
Senior-level Full TimeIN-TN-Chennai3h ago
-
Databricks Data Engineer INR 1500K-2200KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeIN-KA-Bangalore3h ago
-
Mid-level Full TimeIN-MH-Pune3h ago
-
Data Analyst - Security INR 600K-800KCapital Markets | Cash Flow | Cause analysis | Company analysis | Comparable company analysisEntry-level Full TimeAhmedabad, Gujarat, India3h ago
-
Analyst-Data Science INR 1960K-3370KClustering | Data Analysis | Digital analytics | Experimentation | GenAIEntry-level Full TimeGurugram, HR, India4h ago
-
Business Intelligence (Data Analytics & AI) - Associate INR 2000K-4064KAPIs | Alteryx | Data Governance | Data Modeling | Data QualitySenior-level Full TimeMumbai, Maharashtra, India4h ago
-
Data Visualization & Advanced Analytics - Associate INR 1000K-2000KAgile | Alteryx | Data Cleansing | Data Governance | Data QualityMid-level Full TimeMumbai, Maharashtra, India4h ago
-
Associate AI-ML Engineer INR 1200K-2500KAWS | Autogen | Azure | CI/CD | Cloud PlatformsHands-on enterprise projects | Mentorship | Professional developmentMid-level Full TimeBengaluru South, Karnataka, India5h ago
-
Reference Data Analyst INR 663K-1100KCause analysis | Corporate actions | Coupons | Data Cleanup | Data ControlsMid-level Full TimeMumbai, Maharashtra, India5h ago
-
Mid-level Full TimeBangalore, Karnataka, India; Hyderabad, Telangana, India5h ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-5000KAPIs | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
AI Customer Engineer, Manufacturing, Google Cloud USD 207K-301KAI Agent Development Kit | Agent Development Kit | As-a-Service | Audit Logging | Cloud NetworkingConference attendance | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Field Job - Data Quality INR 1000K-1000KData Quality | Data Validation | Data quality monitoring | Excel | Interview Quality AssuranceEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeHyderabad, India6h ago
-
Senior - Azure Data Engineering INR 3000K-4000KApache Spark | Azure | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Lead AI/ML Engineer – Security AI & LLMs INR 3000K-5000KAPI Design | AWS SageMaker | Azure ML | Deep learning | DockerSenior-level Full TimePune, Maharashtra, India8h ago
-
Vice President, Full-Stack Engineer INR 4000K-5000KAI chatbots | AWS | Access Control | Amazon Web Services | AzureExecutive-level Full TimePune, MH, India8h ago
-
Data Engineer INR 1400K-1800KACID transactions | AI Ready | AI Ready Datasets | API | Anomaly DetectionCollaborative team | Health and wellbeing program | Hybrid work modelSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior-level Full TimeGurugram, HR, India9h ago
-
Mid-level Full TimeIndia9h ago
-
Senior Analyst, Advanced Analytics INR 1890K-2700KA/B | A/B Testing | Apache Spark | B testing | EDAEmployee travel creditsSenior-level Full TimeBangalore, India9h ago
-
Senior-level Full TimeMitratech India10h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 56003710h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru10h ago