Senior Data Engineer
Remote
Atribs Metscon Group
Founded in the bustling metropolis of Dubai in 2004, Atribs Metscon Group stands as a beacon of innovation and excellence in the realm of technology and business solutions. For over two decades, we have been dedicated to empowering enterprises...This is a remote position.
Min Work Experience 10+ Years
Role: Senior Data Engineer
- Extensive experience in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc.) across Fractal and contributes to open-source Big Data technologies.
- Write and tune complex Java, MapReduce, and Hive jobs.
- Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very important.
- Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develops top-quality dashboards using industry best practices.
- Manage team of data engineers (both full-time associates and/or third-party resources)
- Analyzes and confirms the integrity of source data to be evaluated.
- Leads in deployment and auditing models and attributes for accuracy.
- Experience with stream-processing systems: Spark-Streaming, Strom etc.
- Experience with object-oriented/object function scripting languages: Python, Scala etc.
- Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data.
- Should be proficient in writing Advanced SQLs, Expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with Azure cloud services is a plus.
- Financial Services Knowledge is a plus.
Requirement:
- Previous experience 10+ as a big data engineer.
- In-depth knowledge of Hadoop (Cloudera), Spark, and similar frameworks.
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
- Own most deliverables for the Big Data team from a delivery perspective.
- Ability to solve complex networking, data, and software issues.
- Able to Effectively Plan & Organize Their Work
- Strong Interpersonal Communication
- Assist others in the completion of their tasks to support the group goals.
- Build and maintain cooperative work relationships with others.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
2
0
0
Category:
Engineering Jobs
Tags: Azure Big Data Business Intelligence Cassandra Hadoop HBase HDFS Java Linux Machine Learning NoSQL Open Source PHP PostgreSQL Python R Ruby Scala Spark SQL Streaming
Region:
Remote/Anywhere
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Principal Data Scientist jobsPrincipal Data Engineer jobsStaff Data Scientist jobsData Manager jobsWriter - Freelance AI Tutor jobsContent writer - Freelance AI Tutor jobsJunior Data Analyst jobsData Scientist II jobsData Science Manager jobsResearch Scientist jobsBusiness Data Analyst jobsSr. Data Scientist jobsSr Data Engineer jobsSenior Machine Learning Researcher jobsLead Data Analyst jobsSoftware Engineer, Machine Learning jobsBI Analyst jobsData Science Intern jobsJunior Data Engineer jobsBusiness Intelligence Engineer jobsSenior AI Engineer jobsAzure Data Engineer jobsData Analyst II jobsCopywriter - Freelance AI Tutor jobsData Engineer III jobs
Linux jobsEconomics jobsSnowflake jobsHadoop jobsOpen Source jobsPhysics jobsRDBMS jobsComputer Vision jobsJavaScript jobsMLOps jobsBanking jobsData Warehousing jobsScala jobsKafka jobsGoogle Cloud jobsAirflow jobsNoSQL jobsData warehouse jobsSAS jobsOracle jobsClassification jobsKPIs jobsPostgreSQL jobsGitHub jobsR&D jobs
Streaming jobsScrum jobsScikit-learn jobsData Mining jobsTerraform jobsLooker jobsCX jobsPySpark jobsPandas jobsJira jobsDistributed Systems jobsRobotics jobsIndustrial jobsReact jobsRedshift jobsJenkins jobsMicroservices jobsBigQuery jobsMySQL jobsMatlab jobsdbt jobsUnstructured data jobsData strategy jobsE-commerce jobsGPT jobs