Senior Data Engineer
RIB United States, Alpharetta, United States
USD 147K-175K (estimate) Senior-level Full Time
Tasks
- Build data ingestion pipelines
- Build data integration components and APIs
- Collaborate on RAG and AI data solutions
- Design data loading and indexing pipelines
- Document data models pipelines and operational processes
- Enable real time and incremental processing
- Implement data transformation and data quality processes
- Implement testing validation and observability
- Monitor pipelines in production and handle maintenance
- Optimize pipeline performance scalability and cost
- Orchestrate and automate data workflows
Perks/Benefits
Skills/Tech-stack
Apache Iceberg | Asynchronous processing | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Key Vault | Azure Managed | Azure Managed Identity | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | CDC | CI/CD | Cosmos DB | Data Factory | Data Modeling | Data Quality | Data freshness | Data quality monitoring | Delta Lake | Dimensional Modeling | Embeddings | Event Driven | Event-driven architecture | Git | Incremental loads | Key Vault | Lakehouse | Managed Identity | Medallion Architecture | Microsoft Fabric | Normalized Data | Normalized data modeling | Observability | Performance Tuning | Quality monitoring | RAG Indexing | RBAC | Retrieval-Augmented Generation | SQL | SQL Database | Streaming Data | Synapse Analytics | Vector Databases
Education
N/A
Related jobs
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States11h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States11h ago
-
Senior-level Full TimeUnited States17h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California17h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R17h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York17h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois17h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA17h ago
-
Applied LLM Systems Engineer USD 191K-253KAccess Management | Agent systems | Auditability | Caching | Cloud infrastructureSenior-level Full TimeCosta Mesa, California, United States19h ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R19h ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R20h ago
-
Senior Data Engineer USD 100K-120KAWS | Agile | Azure | Cloud Architecture | Data Lake401k employer match | Career development | Dental insurance | Employee discounts | Employer Disability BenefitsSenior-level Full TimeBurnsville, MN, US20h ago
-
Senior Quantum Applications Engineer USD 125K-187KArtificial Intelligence | CI/CD | CUDA Quantum | Code review | CryptographySenior-level Full TimeNew Haven, CT20h ago
-
Staff Machine Learning Engineer USD 176K-308KAPI Design | Distributed Systems | Generative AI | Hybrid search | Inference Optimization401k plan with company match | ESPP | Family Leave Program | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R20h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R20h ago
-
Senior Analytics Engineer USD 111K-160KAirflow | Business Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Dental insurance | Fitness Center | Health insurance | Paid time offSenior-level Full TimeLehi, Utah21h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI Integration | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeRichmond21h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeDallas21h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-196KAPIs | AWS | AWS Glue | Amazon Redshift | Apache AirflowSenior-level Full TimeMinneapolis21h ago
-
AI Engineer/Scientist, Staff USD 185K-250KAPIs | Agent Frameworks | Argo CD | Attribution methods | CI/CD401k match | Comprehensive health coverage | Hybrid work environment | Paid Company Holidays | Parental leaveSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R21h ago
-
Principal AI Engineer USD 182K-242KAPI | Access Control | Access Management | Air Gapped Computing | Air-gapped401k match | Dental insurance | Flexible-hybrid work | Health insurance | Life insuranceSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R21h ago
-
AI Engineer/Scientist - Staff USD 185K-242KAPI Development | Agent Frameworks | Argo CD | Artificial Intelligence | Attribution401k match | Equity ownership | Flexible-hybrid work | Health insurance | Life insuranceSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R21h ago
-
Sr Engineer, Data Engineering USD 30K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeRoswell, GA, United States22h ago
-
Data Engineer Intern USD 44K-54KBusiness Intelligence | Cloud Data | Cloud Data Warehouse | Data Modeling | Data VisualizationHybrid workEntry-level InternshipWeave - Headquarters (Lehi, UT) R22h ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA R22h ago