Data Engineer - AWS
Tasks
- Build ETL/ELT jobs
- Collaborate with analytics and business stakeholders
- Convert Oracle SQL to Redshift compatible SQL
- Create data quality checks and reconciliation
- Design data ingestion pipelines
- Extract data from Salesforce
- Implement incremental loads and CDC
- Implement logging alerting and retries
- Land data in Amazon S3
- Load and transform data into Amazon Redshift
- Maintain data governance and documentation
- Monitor pipeline reliability and performance
- Optimize Redshift queries
- Set up scheduling and orchestration
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon Redshift | Amazon S3 | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs | Azure Synapse | CI/CD | Change Data Capture | Data Capture | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehouse | ELT | ETL | Event Hubs | Hadoop | Incremental loads | Informatica | Infrastructure as Code | Kafka | Lakehouse | Oracle | Python | REST APIs | SQL | Scheduling | Snowflake | Spark | Step Functions | Stored Procedures | Talend | “as-code”
Education
N/A
Roles
Related jobs
-
Data Engineer PHP 420K-480KAWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQueryEmployee discount | Health insurance | Mentorship | Sports voucher | Training opportunitiesMid-level Full TimeAlabang, Philippines (Hybrid) R5h ago
-
Data and AI Engineer USD 120K-165KAWS | Agile | Azure | Big Data | Data ArchitecturePublic trust clearance required | Remote workMid-level Full TimeWork from home, VA, United States R5h ago
-
Sr. Data and AI Engineer USD 180K-200KAgile | Amazon Web Services | Azure | Big Data | Data ArchitecturePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R5h ago
-
AWS | Anthropic Claude | Azure | Bedrock | CI/CDAnnual leave | Employee referral program | HMO coverage | Work from homeSenior-level Full TimePasig Central Post Office, Philippines R7h ago
-
Mid Fullstack Software Engineer USD 75K-153KFastAPI | Git | Next.js | PostgreSQL | PythonInternational team collaboration | Remote workMid-level Full TimeRemote R8h ago
-
API | Artificial Intelligence | CI/CD | Concurrency | Design PatternsCareer growth | International projects | Language courses | Medical care | Multisport cardSenior-level Full TimeWarsaw R8h ago
-
App Development | CRM Integrations | Dashboard Development | Data Pipelines | Document processingCareer growth | Modern workplace | Remote workMid-level Full TimeRemote R8h ago
-
Data Analyst GBP 26K-26KBigQuery | CI/CD | DBT | Data Modeling | Data PipelinesCompany events | Dental insurance allowance | Flexible working | Four day week option | Gym membership allowanceMid-level Full TimeLondon, England, United Kingdom R11h ago
-
Business Intelligence Engineer INR 1400K-1700KAgile | Jira | SQL | SnowflakeFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R11h ago
-
Senior Machine Learning Engineer GBP 74K-100KA/B | A/B Testing | Apache Spark | B testing | ClusteringDental insurance allowance | Flexible working | Gym membership allowance | Holiday and bank holidays | Learning and development budgetSenior-level Full TimeLondon, England, United Kingdom R11h ago
-
AI Engineer III (Remote) EUR 48K-62KCI/CD | Distributed Systems | Evaluation | Information Retrieval | JavaAgile Nomads Experience | Buddy onboarding | Coach support | Company welfare programs | Conference attendanceSenior-level Full TimeRende, Italy R13h ago
-
Evaluation Frameworks | Evaluation Pipelines | Function Calling | Java | LLM tool-useEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeBrisbane, QLD, Australia R14h ago
-
Evaluation Pipelines | Function Calling | Governance | Java | LLM tool-useEquity packages | Flexible leave options | Flexible remote work within Australia | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R14h ago
-
Function Calling | Java | LLM tool-use | Langchain | LanggraphEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia R14h ago
-
Ingénieur / ingénieure Data – IA Générative EUR 60K-70KAWS | AWS Bedrock | Azure DevOps | CI/CD | Copilot StudioCareer development support | Diversity inclusion agreements | Employee share participation | Health insurance | Paid time offSenior-level Full TimeÉchirolles, Auvergne-Rhône-Alpes, France R14h ago
-
Sr.EM Data Engineering INR 2800K-3500KAPI Development | AWS | Automated testing | CI/CD | Data ProcessingDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalSenior-level Full TimeIndia (Remote-First) R15h ago
-
Agents SDK | Anthropic Claude | Azure | Azure OpenAI | Cloud RunFlexible working hours | Learning opportunities | Remote workSenior-level Full TimeSouth Jakarta, DKI Jakarta, Indonesia R16h ago
-
Data Engineer (Full-time, Remote) IDR 84000K-84000KApache Airflow | Apache Cassandra | Apache Hive | Apache Kafka | Apache SparkFlexible working hours | Learning opportunities in conversational AI industry | Remote workEntry-level Full TimeSouth Jakarta, DKI Jakarta, Indonesia R16h ago
-
AI/ML Engineer II INR 950K-1250KAWS | Azure | Containerization | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R18h ago
-
AI/ML Engineer II INR 950K-1250KAmazon Web Services | Azure | Cloud platform | Data Preprocessing | Deep learningMid-level Full TimeRemote, India R18h ago
-
Principal Machine Learning Researcher (Physical AI) USD 200K-400KAnomaly Detection | C++ | Computational Geometry | Computer Vision | Deep learning401k | Casual dress | Company holidays | Employer paid Medical Dental Vision Insurance | Flexible work hoursSenior-level Full TimeLos Angeles, CA (On-site) R21h ago
-
Senior-level Full TimeIndia - Hyderabad - Remote R21h ago
-
C# | Combinatorics | Graph theory | Linear Algebra | MATLABFlexible hours | Part-time project-based workSenior-level FreelanceUnited States - Remote R21h ago
-
MATLAB | NumPy | Numerical analysis | Pandas | PythonFlexible schedule | Freelance project-based work | Part-time availability | Remote work likelySenior-level FreelanceArgentina - Remote R21h ago
-
C# | Combinatorics | Graph theory | MATLAB | NumPyProject-based freelanceSenior-level FreelanceSouth Africa - Remote R21h ago