flashgeotext
⚡
🌍
Extract and count countries and cities (+their synonyms) from text, like GeoText on steroids using FlashText, a Aho-Corasick implementation. Flashgeotext is a fast, batteries-included (and BYOD) and native python library that extracts one or more sets of given city and country names (+ synonyms) from an input text.
documentation: https://flashgeotext.iwpnd.pw/
introductory blogpost: https://iwpnd.pw/articles/2020-02/flashgeotext-library
Usage
from flashgeotext.geotext import GeoText
geotext = GeoText()
input_text = '''Shanghai. The Chinese Ministry of Finance in Shanghai said that China plans
to cut tariffs on $75 billion worth of goods that the country
imports from the US. Washington welcomes the decision.'''
geotext.extract(input_text=input_text)
>> {
'cities': {
'Shanghai': {
'count': 2,
'span_info': [(0, 8), (45, 53)],
'found_as': ['Shanghai', 'Shanghai'],
},
'Washington, D.C.': {
'count': 1,
'span_info': [(175, 185)],
'found_as': ['Washington'],
}
},
'countries': {
'China': {
'count': 1,
'span_info': [(64, 69)],
'found_as': ['China'],
},
'United States': {
'count': 1,
'span_info': [(171, 173)],
'found_as': ['US'],
}
}
}
Getting Started
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
Installing
pip:
pip install flashgeotext
conda:
conda install flashgeotext
for development:
git clone https://github.com/iwpnd/flashgeotext.git
cd flashgeotext/
poetry install
Running the tests
poetry run pytest . -v
Authors
- Benjamin Ramser - Initial work - iwpnd
See also the list of contributors who participated in this project.
License
This project is licensed under the MIT License - see the LICENSE.md file for details
Demo Data cities from http://www.geonames.org licensed under the Creative Commons Attribution 3.0 License.
Hello, your method helps me a lot, and I just wanna debug at some point, but much to my suprise, it will show some fatal errors once debug, how can we solve this probelm
3 May 29, 2022
21 Aug 05, 2022
1 Mar 03, 2022
586 Dec 24, 2022
66 Jul 05, 2022
42 Dec 13, 2022
3 Apr 05, 2022
79 Dec 27, 2022
11 Sep 29, 2022
22 Nov 13, 2022
26 Dec 05, 2022
106 Jan 01, 2023
8 Oct 18, 2021
0 Dec 27, 2021
220 Dec 30, 2022
581 Dec 21, 2022
49 Dec 17, 2022
316 Jan 03, 2023
21 Aug 12, 2022
1.6k Dec 27, 2022