Senior Data Engineer
Tasks
- Build and maintain Amazon QuickSight dashboards
- Create QuickSight datasets using Athena queries
- Design build and maintain AWS Glue ETL pipelines
- Develop and optimize AWS Step Functions orchestration
- Follow Git branching and CI CD practices
- Implement incremental loading and schema evolution
- Integrate EventBridge SQS SNS Athena and CloudWatch
- Manage Apache Iceberg tables on S3
- Monitor data freshness and pipeline health
- Optimize QuickSight performance with SPICE and Direct Query
- Optimize pipeline performance and costs
- Own BI delivery lifecycle
- Participate in code reviews and sprint planning
- Perform data quality checks
- Translate Tableau or Excel reports into QuickSight visuals
- Troubleshoot production pipeline failures
Perks/Benefits
Skills/Tech-stack
AWS CDK | AWS Glue | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon QuickSight | Amazon S3 | Amazon SNS | Amazon SQS | Apache Hudi | Apache Iceberg | CI/CD | CloudFormation | Data Modeling | Data Quality | Data orchestration | Delta Lake | Dimensional Modeling | EventBridge | GitHub Actions | IAM | Incremental loading | PySpark | Python | REST APIs | SQL | Schema evolution | Slowly Changing Dimensions | Step Functions | Tableau | Terraform
Education
N/A
Roles
Analyst | BI Analyst | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Data Engineer, Global Affairs INR 1500K-2500KArtificial Intelligence | Big Data | C++ | Cloud platform | Data PipelinesMid-level Full TimeHyderabad, Telangana, India4h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R5h ago
-
AI/ML Engineer INR 2500K-3885KAzure | Deep learning | DeepSpeed | Distributed Systems | DockerCar lease | Certification programs | Corporate pension scheme | Dental & vision coverage | Education reimbursementMid-level Full TimeBangalore, Karnataka, India6h ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R6h ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R6h ago
-
Data Engineer INR 3000K-4000KAWS | Data Architecture | Data Governance | Data Modeling | Data MonitoringBike to work | Career progression | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeBengaluru, KA, India6h ago
-
Senior-level Full Time Part Timebangalore, India6h ago
-
Process Manager INR 500K-1500KDashboard governance | Data Modeling | Data Quality | Data Visualization | ETLMid-level Full TimePune, Maharashtra, India9h ago
-
Quality Data Analyst INR 2500K-4000KAI | Business Intelligence | Dashboard Development | Data Analysis | Data MiningSenior-level Full TimeBengaluru, KA, India R9h ago
-
Junior Agentic AI Engineer (m/f/d) INR 300K-350KAI Foundry | AKS | API Wrappers | Azure AI | Azure AI FoundryAgile collaboration | Career development | Flexible working | International networking | Learning opportunitiesEntry-level Full TimeHyderabad, IN9h ago
-
Senior Agentic AI Engineer (M/F/D) INR 4000K-5500KAI Foundry | AKS | Asyncio | Autogen | Azure AICareer development | Flexible working hours | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN9h ago
-
Data Engineering II INR 1500K-2000KBigQuery | Cloud Composer | Cloud Storage | Data Governance | Data QualityMid-level Full TimeChennai, Tamil Nadu, India10h ago
-
Associate Consultant_SQL_Python INR 1200K-1800KAlgorithms | Automation | C# | Data Structures | GitMid-level Full TimeChennai, IN, 60003210h ago
-
Sr SW Engineer, Machine Learning INR 2500K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Financial wellness support | Flexible work schedule | Mental health support | Retirement plan matchingSenior-level Full TimeBengaluru, India11h ago
-
Senior-level Full TimeGurgaon, Haryāna, India13h ago
-
Senior-level Full TimeBangalore, Karnātaka, India13h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | High responsibilityMid-level Full TimeBangalore, Karnātaka, India13h ago
-
Senior Software QA Engineer INR 2829K-3500KAPI Testing | AWS | Azure | CI/CD | Coverage metricsGlobal offices | Psychologist on staff | Remote work option | Training budgetSenior-level Full TimeNew Delhi, India13h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | Collaborative team | International teamMid-level Full TimeGurgaon, Haryāna, India13h ago
-
Financial Data Analyst II INR 1200K-2000KAutomation | Dashboarding | Data Governance | Data Modeling | Data PipelinesHybrid work model | Work from office at least three days per weekMid-level Full TimeBangalore, KA, IN16h ago
-
Data Analyst (D365 Transformation Program) INR 500K-1500KAzure | Data Governance | Data Quality | Microsoft Excel | Power BIMid-level Full TimeINDIA - BENGALURU - WHITEFIELD SITE, …16h ago
-
Data Analyst INR 660K-900KAWS | Autonomous Agents | Azure | Deep learning | LangchainClient site flexibility | Flexible shifts | Hybrid work environmentMid-level Full TimeBangalore, KA, IN16h ago
-
Data Engineer INR 1500K-2400KAKS | API Management | Amazon Kinesis | Azure | Azure DataHybrid work environmentSenior-level Full TimeBangalore, KA, IN16h ago
-
Mid-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …16h ago
-
IN-Senior Associate_ Data Scientist (AI/ML) __ Data & Analytics _ Advisory _Bangalore INR 3000K-5000KAWS Bedrock | AWS Glue | Amazon S3 | Amazon SageMaker | Azure DataSenior-level Full TimeBengaluru Millenia, India16h ago