Junior Data Engineer
Tasks
- Automate manual data movement
- Build and maintain Azure Data Factory ETL pipelines
- Create runbooks and document ETL logic
- Follow naming standards and controlled releases
- Handle API pagination rate limits and incremental extraction
- Ingest file based data CSV Excel and SFTP
- Integrate third party data sources using REST APIs
- Own data pipeline reliability
- Refactor ETL processes for scalability and maintainability
- Resolve data quality issues
- Troubleshoot pipeline failures and data anomalies
- Tune SQL performance and manage indexing
- Write SQL for data validation and reconciliation
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Azure Data | Azure Data Factory | Azure SQL | CSV | Data Factory | ETL | Excel | JSON | OAuth | Power BI | REST APIs | SFTP | SQL | SQL Server
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeBurlingame, CA1h ago
-
Machine Learning Engineer USD 214K-240KBigtable | Code review | Computer Vision | Data Mining | Data PipelinesMid-level Full TimeBellevue, WA1h ago
-
Data Engineer, Analytics USD 209K-235KData Warehousing | Dimensional Modeling | ETL | MPP | MapReduceEntry-level Full TimeBurlingame, CA1h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KCybersecurity | Dashboarding | Data Transformation | Data Visualization | Data collectionMid-level Full TimeWashington D.C., DC, USA; Atlanta, GA, …1h ago
-
Senior Data Engineer - Remote USD 150K-160KAPIs | Data Governance | Data Lineage | Data Management | Data Modeling401k | Dental insurance | Health and wellness programs | Health insurance | Life insuranceSenior-level Full TimeAtlanta, GA, US, 30328 R5h ago
-
Data Engineer I USD 68K-100KAPI Keys | Azure | Azure Data | Azure Data Factory | Azure Synapse401k match | Employee onboarding program | Flexible PTO | Health and wellness benefits | Onsite optionsEntry-level Full TimeMorrisville, NC, US, 275605h ago
-
Senior Analytics Engineer, Marketing USD 159K-201KAttribution | DBT | Data Modeling | Dimension tables | Dimensional ModelingAnnual equity refresh grants | New hire equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R8h ago
-
Senior-level Full TimeTampa, FL9h ago
-
Principal Data Engineer - Central Product Insights USD 178K-249KAWS | Apache Airflow | Apache Spark | Cloud platform | DBT401k match | Dental insurance | Flexible work schedule | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA12h ago
-
Sr Business Intelligence Engineer, AWS GDSP A&I USD 130K-194KAutomation | Business Analytics | Business Intelligence | Dashboards | Data ArchitectureWork-life balanceSenior-level Full TimeSeattle, Washington, USA13h ago
-
Sr. Business Intelligence Engineer, Prime Video Commerce USD 130K-194KAd-Hoc | Ad-hoc analysis | Automation | Business Intelligence | DashboardingSenior-level Full TimeSeattle, Washington, USA13h ago
-
Machine Learning Engineer USD 90K-167KData Modeling | Data Pipelines | Data Querying | Data Transformation | Data VisualizationDental insurance | Health insurance | Hybrid work environment | Mentorship | Paid time offMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …13h ago
-
AI Tech Partner (USA) USD 150K-230KAWS | Apache Airflow | Azure | BigQuery | CI/CDCareer development opportunities | Entrepreneurial environment | Fast growing team environment | High degree of individual responsibilitySenior-level Full TimeJersey City, New Jersey, United States13h ago
-
Data Platform Engineer USD 140K-200KAWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatch | Amazon ECSSenior-level Full TimeFort Lauderdale, FL, US13h ago
-
Apache Spark | Data Modeling | Data Quality | Data pipeline | LoggingEmployee travel credits | Remote work eligibilitySenior-level Full TimeUnited States14h ago
-
Senior Data Engineer USD 120K-126K3NF | API Design | API Management | API Versioning | APIM401k match | Charitable Gift Matching | Dental insurance | Discounted personal insurance | Employee stock ownership planSenior-level Full TimeWestern States or Midwest14h ago
-
Analytics Consultant USD 98K-150KAWS | Amazon Web Services | Analytics engineering | Business Intelligence | Dashboard DevelopmentHybrid work | Remote work eligibilitySenior-level Full TimeHouston, Texas, United States14h ago
-
Analytics Consultant USD 98K-150KAmazon Web Services | Dashboard Development | Data Governance | Data Modeling | Data QualityHybrid work schedule | Remote work optionSenior-level Full TimeLehi, Utah, United States14h ago
-
Sr. Analytics Engineer USD 145K-195KAvo | BigEye | BigQuery | DBT | Data CatalogCommuter benefits | Dog-friendly office | Flexible working hours | Free gympass subscription | Home office stipendSenior-level Full TimeSan Francisco, CA, Brooklyn, NY, Cambridge, … R14h ago
-
Senior Analytics Consulting Manager USD 142K-185KData Analysis | Data Science | Data Visualization | Healthcare Analytics | Machine Learning401k match | Disability insurance | Flexible time off | Health, dental, vision insurance | HolidaysSenior-level Full TimeUnited States R15h ago
-
Software Engineers/Data Scientists USD 140K-253KAWS | AWS Secrets | AWS Secrets Manager | Amazon RDS | Bash401k match | Employer-covered health insurance | Employer-covered life insurance | Family Vision Insurance | Family dental insuranceSenior-level Full TimeChantilly, VA15h ago
-
Data Engineer USD 115K-135KAPIs | Anomaly Detection | CDC | CI/CD | Cause analysis401k matching | Dental insurance | Health insurance | Paid Maternity Leave | Paid time offSenior-level Full TimeChicago, Illinois, United States15h ago
-
Staff Data Engineer, Search and Discovery USD 142K-309KAirflow | Amazon S3 | DBT | Dagster | Distributed Systems401k plan | Dental insurance | Employee assistance program | Flexible spending account | Health insuranceSenior-level Full TimeMountain View, USA15h ago
-
Senior Director - Data Platform & Analytics USD 178K-255KAccess Control | Airbyte | BigQuery | DBT | Data Governance401k | Educational reimbursement | Fertility and adoption assistance | Flexible paid time off | Health benefitsSenior-level Full TimeRemote (United States) R15h ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Equity | Family planning resources | Flexible vacation policySenior-level Full TimeRemote - USA R15h ago