Data Pipeline & Integration Engineer
Miami Lakes, FL, United States
USD 85K-121K (estimate) Mid-level Full Time
Tasks
- Collaborate with Business Analysts on data requirements
- Configure error handling and restartability
- Coordinate QA scheduling deployment and execution
- Design data flows staging ODS data warehouse
- Develop ETL pipelines
- Develop data interfaces across systems
- Ensure data governance and audit compliance
- Implement ETL transformations
- Implement data validation reconciliation controls
- Improve pipeline reliability
- Maintain ETL mappings workflows sessions
- Maintain pipeline and interface documentation
- Monitor production ETL jobs
- Optimize ETL performance and scalability
- Support audit reconciliation and data lineage
- Troubleshoot ETL failures from logs
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | DBT | Data Governance | Data Lineage | Data Quality | Data Reconciliation | Data Warehouse | ELT | ETL | Informatica IDMC | Informatica PowerCenter | Python | SQL | Snowflake | Streaming
Related jobs
-
Entry-level InternshipSan Jose7h ago
-
eCommerce Analytics Principal USD 120K-145KAnalytics reporting | Attribution Modeling | BigQuery | Client side | Client-side tracking401k | Dental insurance | Disability insurance | Employee discounts | Learning and development opportunitiesSenior-level Full TimeNashville, TN, United States9h ago
-
Generative AI Engineer III - State and Local Government USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Generative AI | Language ModelsMentorship | Professional development | Travel opportunitiesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …13h ago
-
IT Data Engineer USD 117K-124KANSI X12 | ARM Templates | Automl | Azure | Azure DataBackground screening provided | Flexible work hours | Mentorship | Professional development opportunitiesSenior-level Full TimeUS - Remote R13h ago
-
Mid-level Full TimeSeattle, Washington, United States14h ago
-
Atlassian Confluence | Atlassian Jira | Azure Data | Azure Data Factory | CI/CDOnsite work benefits | Potential project extensionsSenior-level Full TimeJuno Beach, FL14h ago
-
C++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeSan Diego, CA, USA15h ago
-
Senior Software Engineer, Generative AI, Core ML USD 174K-253KAgent systems | Computer Vision | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA15h ago
-
Staff Software Engineer, Generative AI USD 207K-301KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Staff Software Engineer, Google Cloud Agentic AI USD 207K-301KAgentic AI | Artificial Intelligence | C++ | Compliance | Distributed ComputingBonus | Equity | Health insurance | Paid time off | Retirement planSenior-level Full TimeNew York, NY, USA15h ago
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Data Management401k match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeSanta Clara, CALIFORNIA, United States21h ago
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R23h ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | Critical Systems401k | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | Data Ingestion | Data Ingestion Pipelines | Deployment401k | Health insurance | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R1d ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R1d ago
-
AI/ML Engineer USD 92K-97KApache Spark | Data Pipelines | Databricks | Feature Engineering | LLM401k retirement plan | Dental insurance | Employee assistance program | Medical insurance | Paid HolidaysSenior-level Full TimeUSA, NE, Work-at-Home, United States1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Data Quality | Data labeling100 percent remote work | Career growth opportunities | Visa transfer support for qualified candidatesMid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer - Data & Analytics Technology USD 58K-142KBig Data | Business Intelligence | Data Architecture | Data Mining | Data ModelingMid-level Full TimeFirstside Center Bldg (PA373), United States1d ago
-
Quantitative Analytics Professional USD 105K-157KAgentic Workflows | Apache Spark | Generative AI | Language Models | Large Language ModelsMid-level Full TimeHeadquarters 4, United States1d ago
-
Principal Engineer, Data Engineering USD 129K-155KAPI | AWS | Agile | Azure | CI/CDHybrid work model | Life and disability benefits | Life insurance | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeFL - Saint Petersburg - 880 …1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseLong-term career growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 110K-166KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data ValidationContinuous learning resources | Employee ownership | Inclusive culture | Training and mentorshipMid-level Full TimeClient Site - Washington, D.C., United …1d ago