Data Lake Engineer
Doral, FL, United States
USD 107K-195K (estimate) Senior-level Full Time
Tasks
- Administer data lake platform workspaces and clusters
- Build ETL/ELT pipelines
- Configure SPARQL endpoint access
- Design data lake architectures
- Enforce access control policies
- Implement data governance and compliance reporting
- Implement data lake ingestion for structured and unstructured data
- Implement identity and access management with RBAC
- Implement storage tiering strategies
- Integrate AI/ML workflows
- Integrate Unity Catalog for secure data governance
- Manage DevSecOps version control and CI CD pipelines
- Manage cloud security best practices
- Manage data lake integration with knowledge graph platform
- Optimize ETL pipelines for high volume transformation
- Optimize data lakehouse performance
- Tune performance and optimize ingestion efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Access Management | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Databricks | Databricks SQL | Delta Lake | DevSecOps | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Identity and Access Management | Identity and access | NoSQL | Python | Role-Based Access | Role-Based Access Control | SPARQL | SQL | Storage tiering | SysEngOps | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Telemetry Data Engineer USD 110K-128KAnomaly Detection | Azure Data | Azure Data Explorer | Data Engineering | Data Explorer401k retirement plan | Medical/Dental/VisionMid-level ContractRedmond, Washington, USA R4h ago
-
Automated testing | Build Automation | C++ | CI/CD | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractDallas, Texas, USA R5h ago
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R6h ago
-
Automated testing | C++ | CI/CD | Firmware Build | Firmware Testing401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractAtlanta, Georgia, USA R6h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KApache Hive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States8h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure ML | CI/CD | Cloud Computing | ColBERT401K retirement with match | Bonus eligibility | Childcare benefits | Gym access | Health Dental Vision Life Disability CoverageSenior-level Full TimeQuincy, MA, United States8h ago
-
Senior Cloud Data Ops Engineer USD 140K-180KAWS RDS | Amazon Aurora | Bash | BigQuery | CI/CD401k match | Childcare benefits | Gym access | Insurance coverage | Paid on-call rotationsSenior-level Full TimeQuincy, MA, United States8h ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Medical/Dental/Vision | Mental health support | Retirement plans | Rewards and recognitionSenior-level Full TimeRemote, United States9h ago
-
Data Engineer USD 126K-208KAPI Integration | AWS | Airflow | Azure | BigQueryDiversity, Equity, and Inclusion Initiatives | Employee rewards and recognition | Mental health support | Sustainability initiatives | Wellness programMid-level Full TimeRemote, United States9h ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R10h ago
-
Amazon Web Services | Angular | Artificial Intelligence | Azure | CI/CDFlexible work from home | Onsite work 2 to 3 days per weekSenior-level Full TimeParamus, NJ, US10h ago
-
BE CAD Physical Impl and AI Engineer USD 401KAI for Design | AI for Design Optimization | ASIC | Automation | Back End CAD401k match | Dental plan | Educational assistance | Health benefits | Hybrid workSenior-level Full TimeAustin,Texas,United States R11h ago
-
Automated testing | Automation | C++ | CI/CD | Embedded Linux401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractHouston, Texas, USA11h ago
-
Generative AI Engineer USD 100K-170KAPIs | AWS Bedrock | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeCenter, Center District, IL11h ago
-
Senior-level Full TimeAnnapolis Junction, United States R11h ago
-
Mid-level Full TimeBedminster, United States11h ago
-
Software Engineer, Parallel Scientific Computing USD 130K-190KBenchmarking | C++ | CUDA C++ | Computer Architecture | High PerformanceEntry-level Full TimeRedwood City12h ago
-
Software Engineer, Scientific Computing USD 130K-190KCUDA | Inverse problems | Numerical Methods | Performance optimization | PythonEntry-level Full TimeRedwood City12h ago
-
Entry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL12h ago
-
Backend & Data Developer (.NET Core / Cloud) USD 115K-150KAWS | AWS Lambda | Alteryx | Amazon Athena | Amazon RedshiftSenior-level Full TimeCenter, Center District, IL R12h ago
-
Palantir Engineer - AI and Data Science Engineer III USD 131K-218KArtificial Intelligence | Data Engineering | Data Modeling | Data Pipelines | Data TransformationActive secret clearanceSenior-level Full TimeHuntsville, Alabama, United States12h ago
-
Data Engineer III USD 124K-207KAmazon Web Services | Apache Spark | Cloud platform | Databricks | Google CloudAbility to obtain security clearance | Professional developmentSenior-level Full TimeRosslyn, Virginia, United States12h ago
-
Senior Data Engineer USD 179K-318KAI/ML | Apache Airflow | Big Data | Data Deduplication | Data MatchingHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Chantilly13h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KAutomation | Benchmarking | Data Analysis | Language Models | Language ProcessingCareer development workshops | Hands-on projects | Industry exposure | Social eventsEntry-level InternshipSan Jose, California, United States13h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAnalytics | Batch Processing | Data Engineering | Data Governance | Data LakeEntry-level Full TimeSan Jose, California, United States13h ago