Senior Data Engineer
RIB United States, Alpharetta, United States
USD 147K-175K (estimate) Senior-level Full Time
Tasks
- Build data ingestion pipelines
- Build data integration components and APIs
- Collaborate on RAG and AI data solutions
- Design data loading and indexing pipelines
- Document data models pipelines and operational processes
- Enable real time and incremental processing
- Implement data transformation and data quality processes
- Implement testing validation and observability
- Monitor pipelines in production and handle maintenance
- Optimize pipeline performance scalability and cost
- Orchestrate and automate data workflows
Perks/Benefits
Skills/Tech-stack
Apache Iceberg | Asynchronous processing | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Key Vault | Azure Managed | Azure Managed Identity | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | CDC | CI/CD | Cosmos DB | Data Factory | Data Modeling | Data Quality | Data freshness | Data quality monitoring | Delta Lake | Dimensional Modeling | Embeddings | Event Driven | Event-driven architecture | Git | Incremental loads | Key Vault | Lakehouse | Managed Identity | Medallion Architecture | Microsoft Fabric | Normalized Data | Normalized data modeling | Observability | Performance Tuning | Quality monitoring | RAG Indexing | RBAC | Retrieval-Augmented Generation | SQL | SQL Database | Streaming Data | Synapse Analytics | Vector Databases
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R23d ago
-
Data Engineer USD 91K-114KANSI SQL | API | Amazon Redshift | Apigee | Azure401k with company match | Bereavement leave | Employee assistance program | Employee discount program | Family planning benefitsMid-level Full TimeRemote - Nationwide, United States R22h ago
-
Senior Data Engineer USD 111K-139KAPI Integration | Amazon Redshift | Apigee | Azure | BI Publisher401k match | Bereavement leave | Dental insurance | Employee assistance program | Employee discountsSenior-level Full TimeRemote - Nationwide, United States R22h ago
-
Data Platform Engineer-Solutions Delivery USD 125K-174KAPI Integration | API Management | APIs | Azure API | Azure API Management401k matching | Company holidays | Employee purchase program | Medical/Dental/Vision | Paid time offSenior-level Full TimeMerriam, KS, United States23h ago
-
Software Engineer, Platform USD 165K-225KAWS | Asynchronous processing | CI/CD | Data Pipelines | Debugging401k access | Company-sponsored fitness classes | FSA and HSA Access | Health, dental and vision coverage | Meals providedEntry-level Full TimeSan Francisco1d ago
-
Data Product Operations Lead USD 145K-175KData Pipelines | Data Quality | ETL | Metrics | Production Monitoring401k | Dental insurance | FSA | Gym classes | HSASenior-level Full TimeSan Francisco / New York City1d ago
-
Staff Software Engineer, Platform USD 195K-315KAPI Design | AWS | Asynchronous processing | Backend Development | CI/CD401k | Dental insurance | FSA | Fitness classes | HSASenior-level Full TimeSan Francisco1d ago
-
Access Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | Remote workSenior-level ContractSaint Paul, United States1d ago
-
Data Scientist Associate USD 77K-80KAPIs | Access Control | Artificial Intelligence | Audit Logging | BenchmarkingOnsite work locationMid-level Full TimeUniversity1d ago
-
Mid-level Full TimeUS-IL-Chicago1d ago
-
API | Airflow | Amazon Web Services | Apache Spark | AzureLearning and development | Mentorship | Travel opportunitiesEntry-level Full TimeAtlanta, Georgia, United States; Boston, Massachusetts, …1d ago
-
Database Engineer - Government & Public Services USD 113K-188KBackup and Recovery | Data platform | Database Administration | Database Design | Database troubleshootingCompetitive benefits package | Mentorship and guidance | Travel opportunitiesMid-level Full TimeLake Mary, Florida, United States1d ago
-
databricks engineer - Delivery Senior Consultant, Data Engineering and Conversion Solutions USD 124K-213KAPI | Agile | Data Governance | Data Modeling | Data QualityHybrid work model | Travel 10 percentSenior-level Full TimeLake Mary, Florida, United States1d ago
-
Cyber Data Scientist, Analytics and Insights USD 102K-171KCloud Computing | Data Modeling | Data Pipelines | Jira | Machine LearningMid-level Full TimeHuntsville, Alabama, United States1d ago
-
Data Engineer, Product Analytics (University Grad) USD 173K-196KCompliance | Data Modeling | Data Quality | Data Security | Data TransformationCareer growth | Skill developmentNone Full TimeMenlo Park, CA | New York, …1d ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | Application Performance Tuning | Application performance | C++ | CI/CDSenior-level Full TimeMountain View, CA, USA; New York, …1d ago
-
AI Deployment Lead – Devin AI | Onsite USD 44K-154KAPI Design | Access Management | Agent Orchestration | Agentic Systems | CI/CD401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States1d ago
-
Senior Engineer, Big Data USD 134K-170KAmazon Web Services | Apache Spark | Automated testing | Azure | CI/CDSenior-level Full TimeUnited States1d ago
-
Software Engineer, Data Engineering USD 70K-200KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeIrvine, CA1d ago
-
Senior-level Full TimeHouston, TX, US1d ago
-
AI Engineer II USD 60K-90KAPI Development | Backend Development | Cloud Computing | Databricks | DockerOnsite workMid-level Full TimeLocation Irving, Texas1d ago
-
APIs | AWS CloudWatch | AWS Kinesis | Agile | Amazon DynamoDB401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeIrving, Texas, United States1d ago
-
Staff Frontier Agents Engineer (Applied AI) USD 252K-315KA/B | A/B Testing | AWS | Ablation Studies | AzureCommuter stipend | Generous PTO | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Senior Frontier Agents Engineer (Applied AI) USD 216K-270KA/B Testing | AWS | Ablation Studies | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago
-
Frontier Agents Engineer (Applied AI) USD 180K-225KA/B | A/B Testing | AWS | Ablation Studies | Agent FrameworksCommuter stipend | Dental insurance | Health insurance | Learning and development stipend | Paid time offMid-level Full TimeSan Francisco, CA; Seattle, WA; New …1d ago