An End-To-End Open-Source Framework For Economic Large Language Models (FinLLMs)
Large language models have increased due to the ongoing development and advancement of artificial intelligence, which has profoundly impacted the state of natural language processing in various fields. The potential use of these models in the financial sector has sparked intense attention in light of this radical upheaval. However, constructing an effective and efficient open-source economic language model depends on gathering high-quality, pertinent, and current data. The use of language models in the financial sector exposes many barriers. These vary from challenges in getting data, maintaining various data forms and kinds, and coping with inconsistent data quality to the crucial need for current information.
Extracting historical or specialized financial data becomes challenging due to various data sources, including web platforms, APIs, PDF documents, and photos. To train language models specifically for the banking industry, proprietary models like BloombergGPT have used their exclusive access to specialized data. However, the need for a more open and inclusive alternative has increased due to the limited accessibility and openness of their data gathering and training processes. In response to this need, they observe a changing trend toward democratizing Internet-scale financial data in the open-source sector. Researchers from Columbia University and New York University (Shanghai) discuss similar issues with financial data in this research and provide FinGPT, an end-to-end open-source framework for economical large language models (FinLLMs).
FinGPT emphasizes the critical significance of data collecting, cleaning, and preprocessing in creating open-source FinLLMs using a data-centric approach. FinGPT seeks to advance financial research, cooperation, and innovation by promoting data accessibility and laying the foundation for open finance practices. The following is a summary of their contributions:
• Democratization: The open-source FinGPT framework aspires to democratize access to financial data and FinLLMs by showcasing the unrealized promise of available finance.
• Data-centric approach: Realizing the value of data curation, FinGPT takes a data-centric approach and employs stringent cleaning and preprocessing techniques for dealing with various data formats and kinds, resulting in high-quality data.
FinGPT adopts a full-stack framework for FinLLMs with four layers that is an end-to-end framework.
– Data source layer: By capturing information in real-time, this layer ensures thorough market coverage while addressing the temporal sensitivity of financial data.
– Data engineering layer addresses the inherent difficulties of high temporal sensitivity and poor signal-to-noise ratio in financial data. It is ready for real-time NLP data processing.
– Layer LLMs: This layer, which focuses on a variety of fine-tuning approaches, reduces the extremely dynamic character of financial data and ensures the correctness and relevance of the model.
– Application layer: This layer emphasizes the potential of FinGPT in the financial industry by showcasing real-world applications and demos.
They want FinGPT to act as a catalyst for fostering innovation in the finance industry. In addition to its technical contributions, FinGPT fosters an open-source environment for FinLLMs, encouraging real-time processing and user-specific adaptation. FinGPT is positioned to change its knowledge and use of FinLLMs by fostering a strong ecosystem of cooperation within the open-source AI4Finance community.
Source: https://www.marktechpost.com/2023/06/16/meet-fingpt-an-open-source-financial-large-language-model-llms/
