A Transformer-Enhanced Deep Learning Framework for Contextual Morphological Parsing in NLP Applications

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1016/j.procs.2025.08.263
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Morphological parsing—the segmentation and labeling of the minimal meaningful units within words remains a core challenge for natural language processing, particularly in morphologically rich and low-resource languages. We introduce a Transformer-enhanced deep learning framework that jointly performs morpheme boundary detection and label classification in a single end-to-end model. Our approach fuses character-level embeddings with subword contextualization, employs sinusoidal positional encodings, and augments multi-head self-attention to emphasize affix sequences. A novel joint decoding mechanism synchronizes segmentation and labeling, reducing error propagation inherent in pipelined architectures. We evaluate the proposed model on multiple languages with diverse typological characteristics, achieving an average segmentation F1 improvement of 3.7 % and a labeling accuracy gain of 4.2 % over state-of-the-art CNN-BiLSTM and subword tagging baselines. Embedding visualizations reveal clear semantic and morphological clusters, confirming effective context-driven representation learning. Additionally, an interactive 3D embedding interface facilitates qualitative error analysis and lexicon refinement in low-resource settings. Our framework demonstrates scalability and adaptability, outperforming existing systems in both high- and low-resource scenarios while maintaining robustness on unseen morphemes. Future work will address dynamic input handling for extremely long word forms and explore model compression techniques for real-time deployment. This study establishes a unified, scalable solution for high-precision morphological analysis across typologically varied languages.