Overview - Methods

This page gives an overview of methodological approaches in the field of OJA analysis. Each method is linked to its respective section in this guide.

Data Collection

• Landscaping Data Sources and OJA Landscaping
• Web Scraping Web Scraping
• API Data Collection API Data Collection / Data Providers
• Data Formats Job Posting Data Schema

Data Enrichment and Methods

• Text Segmentation Text Segmentation
• Duplicate Identification Identifying Duplicates
• Natural Language Processing and Data Pre-Processing Pre-Processing and Embeddings
• Rule-based Matching Rule-Based Matching
• Supervised Document Classification #supervised-classification
• Named-Entity Recognition #statistical-named-entity-recognition-token-classification
• Disambiguation/ Entity Linking Semantic Similarity

Evaluation and Quality Control

• Gold Standard Annotation Gold Standard Annotation and Quality
• Machine Learning Evaluation Evaluation

Taxonomies and Ontologies

• Taxonomy Development Developing a Taxonomy
• Taxonomy Evaluation Data Standards for Taxonomies and Ontologies

Dataset Curation and Representativity Analysis

• Sampling Filtering Data
• Deduplication Deduplication
• Representativity Analysis Representativity Analysis