3.725 Ofertas de Big Data en España

Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2,000 companies. Applied R&D, technological services, highly specialized training, technological consultancy or valorisation and exploitation of industrial property are some of the services that Eurecat offers for both large and small and medium-sized enterprises in all sectors. The technology centre participates in more than 200 large national and international consortium projects of high strategic R&I and has 181 patents and 10 spin-offs. The added value provided by Eurecat accelerates innovation, reduces spending on scientific and technological infrastructures, reduces risks and provides specialized knowledge tailored to each company.

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

FUNCTIONS AND RESPONSIBILITIES OF THE JOB:

· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.

· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.

· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.

· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.

· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).

· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.

· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)

REQUIREMENTS:

· MsC in Computer Science. Other technical background will also be considered (Engineer, Mathematics, Physics, etc.) and PhD or Masters in this field will be highly valuated.

Experience

· Implementation of data catalogues (CKAN), data brokers and data connectors (DSSC, Eclipse, Fiware)

· Airflow and Python based E(L)TL data pipelines.

· Cloud providers technological stack (Serverless functions, Virtual Computing Resources, Storage).

· Software patterns best practices as well as knowledge from Data Mining and Machine Learning.

· Languages and programming tools (Python, Java, Scala, SQL, C/C++, Git, Docker)

· DevOps knowledge and experience in Linux is a big plus, specially deploying and maintaining big data infrastructures using Ambari or Ansible.

· Interest in Research, Innovation & Patent Publication, Conference Presentations, Prototyping, Full Lifecycle Product Development.

Languages

· Excellent written and oral communication skills in English.

· Catalan and/or Spanish would be desirable.

WHAT CAN EURECAT OFFER YOU?

• Permanent contract.
• Hybrid work (home office/ work in the office).
• Flexible Schedule.
• Shorter workday on Friday and Summer Schedule.
• Flexible remuneration package (health insurance, transport, lunch, studies - training and kindergarten).
• Eurecat employees can join the Eurecat Academy courses.
• Language courses (English, Catalan and Spanish).

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

FUNCTIONS AND RESPONSIBILITIES OF THE JOB:

· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.

· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.

· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.

· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.

· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).

· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.

· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)

Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2,000 companies. Applied R&D, technological services, highly specialized training, technological consultancy or valorisation and exploitation of industrial property are some of the services that Eurecat offers for both large and small and medium-sized enterprises in all sectors. The technology centre participates in more than 200 large national and international consortium projects of high strategic R&I and has 181 patents and 10 spin-offs. The added value provided by Eurecat accelerates innovation, reduces spending on scientific and technological infrastructures, reduces risks and provides specialized knowledge tailored to each company.

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

FUNCTIONS AND RESPONSIBILITIES OF THE JOB:

· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.

· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.

· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.

· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.

· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).

· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.

· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)

REQUIREMENTS:

· MsC in Computer Science. Other technical background will also be considered (Engineer, Mathematics, Physics, etc.) and PhD or Masters in this field will be highly valuated.

Experience

· Implementation of data catalogues (CKAN), data brokers and data connectors (DSSC, Eclipse, Fiware)

· Airflow and Python based E(L)TL data pipelines.

· Cloud providers technological stack (Serverless functions, Virtual Computing Resources, Storage).

· Software patterns best practices as well as knowledge from Data Mining and Machine Learning.

· Languages and programming tools (Python, Java, Scala, SQL, C/C++, Git, Docker)

· DevOps knowledge and experience in Linux is a big plus, specially deploying and maintaining big data infrastructures using Ambari or Ansible.

· Interest in Research, Innovation & Patent Publication, Conference Presentations, Prototyping, Full Lifecycle Product Development.

Languages

· Excellent written and oral communication skills in English.

· Catalan and/or Spanish would be desirable.

WHAT CAN EURECAT OFFER YOU?

• Permanent contract.
• Hybrid work (home office/ work in the office).
• Flexible Schedule.
• Shorter workday on Friday and Summer Schedule.
• Flexible remuneration package (health insurance, transport, lunch, studies - training and kindergarten).
• Eurecat employees can join the Eurecat Academy courses.
• Language courses (English, Catalan and Spanish).

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

FUNCTIONS AND RESPONSIBILITIES OF THE JOB:

· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.

· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.

· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.

· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.

· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).

· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.

· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)

Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2,000 companies. Applied R&D, technological services, highly specialized training, technological consultancy or valorisation and exploitation of industrial property are some of the services that Eurecat offers for both large and small and medium-sized enterprises in all sectors. The technology centre participates in more than 200 large national and international consortium projects of high strategic R&I and has 181 patents and 10 spin-offs. The added value provided by Eurecat accelerates innovation, reduces spending on scientific and technological infrastructures, reduces risks and provides specialized knowledge tailored to each company.

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

FUNCTIONS AND RESPONSIBILITIES OF THE JOB:

· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.

· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.

· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.

· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.

· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).

· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.

· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)

REQUIREMENTS:

· MsC in Computer Science. Other technical background will also be considered (Engineer, Mathematics, Physics, etc.) and PhD or Masters in this field will be highly valuated.

Experience

· Implementation of data catalogues (CKAN), data brokers and data connectors (DSSC, Eclipse, Fiware)

· Airflow and Python based E(L)TL data pipelines.

· Cloud providers technological stack (Serverless functions, Virtual Computing Resources, Storage).

· Software patterns best practices as well as knowledge from Data Mining and Machine Learning.

· Languages and programming tools (Python, Java, Scala, SQL, C/C++, Git, Docker)

· DevOps knowledge and experience in Linux is a big plus, specially deploying and maintaining big data infrastructures using Ambari or Ansible.

· Interest in Research, Innovation & Patent Publication, Conference Presentations, Prototyping, Full Lifecycle Product Development.

Languages

· Excellent written and oral communication skills in English.

· Catalan and/or Spanish would be desirable.

WHAT CAN EURECAT OFFER YOU?

• Permanent contract.
• Hybrid work (home office/ work in the office).
• Flexible Schedule.
• Shorter workday on Friday and Summer Schedule.
• Flexible remuneration package (health insurance, transport, lunch, studies - training and kindergarten).
• Eurecat employees can join the Eurecat Academy courses.
• Language courses (English, Catalan and Spanish).

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

Functions and responsibilities of the job:

• Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.
• Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.
• Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.
• Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.
• Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).
• When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.
• Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)

Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2,000 companies. Applied R&D, technological services, highly specialized training, technological consultancy or valorisation and exploitation of industrial property are some of the services that Eurecat offers for both large and small and medium-sized enterprises in all sectors. The technology centre participates in more than 200 large national and international consortium projects of high strategic R&I and has 181 patents and 10 spin-offs. The added value provided by Eurecat accelerates innovation, reduces spending on scientific and technological infrastructures, reduces risks and provides specialized knowledge tailored to each company.
EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .
FUNCTIONS AND RESPONSIBILITIES OF THE JOB:
· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.
· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.
· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.
· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.
· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).
· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.
· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description.)
Requirements REQUIREMENTS:
· MsC in Computer Science. Other technical background will also be considered (Engineer, Mathematics, Physics, etc.) and PhD or Masters in this field will be highly valuated.
Experience
· Implementation of data catalogues (CKAN), data brokers and data connectors (DSSC, Eclipse, Fiware)
· Airflow and Python based E(L)TL data pipelines.
· Cloud providers technological stack (Serverless functions, Virtual Computing Resources, Storage).
· Software patterns best practices as well as knowledge from Data Mining and Machine Learning.
· Languages and programming tools (Python, Java, Scala, SQL, C/C++, Git, Docker)
· DevOps knowledge and experience in Linux is a big plus, specially deploying and maintaining big data infrastructures using Ambari or Ansible.
· Interest in Research, Innovation & Patent Publication, Conference Presentations, Prototyping, Full Lifecycle Product Development.
Languages
· Excellent written and oral communication skills in English.
· Catalan and/or Spanish would be desirable.
WHAT CAN EURECAT OFFER YOU?
Permanent contract.
Hybrid work (home office/ work in the office).
Flexible Schedule.
Shorter workday on Friday and Summer Schedule.
Flexible remuneration package (health insurance, transport, lunch, studies - training and kindergarten).
Eurecat employees can join the Eurecat Academy courses.
Language courses (English, Catalan and Spanish).
Department: Data Science & Big Data Analytics
#J-18808-Ljbffr

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .
FUNCTIONS AND RESPONSIBILITIES OF THE JOB:
· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.
· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.
· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.
· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.
· Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).
· When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.
· Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description.)

#J-18808-Ljbffr

Overview

MCA is a European engineering and technology consulting company,

which has 1450 employees and 110 million euros in sales.

Thanks to our 30 years of experience, we accompany our large customers in their efforts to

accounts in the realization of their projects.

Would you like to join a growing company that will give you all the information you need?

the keys to develop your career? Apply now!

MCA Spain is a company specialized in Software and IT, and we work on cutting-edge projects for clients in sectors such as Life Science, Aeronautics, Energy, Mobility, Banking, Insurance, Telcos.

MCA Engineering is based in France, but we have offices in other parts of the world : Sweden, Belgium, The Netherlands, Germany, Italy, China. We are growing fast in Spain (Madrid and Barcelona) and right now we need to expand our Data Engineering team.

• A person with a desire to further develop his career as a Data Engineer and with at least 1 year of experience using different languages and technologies :
• That you have worked at least 1 year with SPARK, developing with Scala / Python / Java in Data projects.
• ETLs
• Experience with relational databases, particularly MySQL.
• Familiarity with Cloud environments (AWS, Azure or Google Cloud).
• Experience with Hadoop, Hive technologies also highly valued!
• Someone who is eager to keep learning and adapts well to change.
• You like to work in a team.
• You have a passion for data and technology.
• You have a Degree / Career / Bachelor's Degree in Computer Engineering / Computer / Software.
• Spanish (Native level).
• English (B2).
• Any other language is welcome.

• Permanent contract with us.
• Personalized career plan, mark your own path.
• Financial assistance for training.
• Full medical insurance.
• Surround yourself with the BEST team of professionals in the sector.
• Flexibility
• Great working environment ;)
• Come to MCA Spain and take your career to the next level !
• Confidentiality is guaranteed throughout the entire hiring process.