FB-Extractor - extract data from a .fb2 file - Oleksiy Lavrynenko

Hello everybody! Not so long ago there was a discussion on Facebook – how to clean up the library on a local device? Considering that I mostly read .fb2 files, today’s question will sound like a solution to the problem: we extract data from the .fb2 file. And at the same time we put things in order on the screw 🙂

The crux of the problem: when we download a book – most often it has a completely abnormal title (for example: Piz_Novyy-yazyk-telodvizheniy.RoTD5Q.393030.fb2 – yes, in general, it’s understandable, but still …). Considering that it is difficult to guess what this is about by this quack, the question arose, is it possible to somehow determine the author, name, and rename the file accordingly? Quite possible!

So what is a .fb2 file? In fact, it is an .xml document. And since this is an .xml document, then it can and should be parsed 🙂

The problem I ran into at the very beginning was to determine the file encoding. In theory, it was possible to randomly open a file in any encoding, look for the encoding header inside the file itself, and proceed from this to work. But the code was so large that I had to use the library chardet, which works with the following encodings:

ASCII, UTF-8, UTF-16 (2 variants), UTF-32 (4 variants)

Big5, GB2312, EUC-TW, HZ-GB-2312, ISO-2022-CN (Traditional and Simplified Chinese)

EUC-JP, SHIFT_JIS, CP932, ISO-2022-JP (Japanese)

EUC-KR, ISO-2022-KR (Korean)

KOI8-R, MacCyrillic, IBM855, IBM866, ISO-8859-5, windows-1251 (Cyrillic)

ISO-8859-5, windows-1251 (Bulgarian)

ISO-8859-1, windows-1252 (Western European languages)

ISO-8859-7, windows-1253 (Greek)

ISO-8859-8, windows-1255 (Visual and Logical Hebrew)

TIS-620 (Thai)

As a result, the code takes the .fb2 file, parses it, finds the author of the book, the title of the book and saves this file in the video “Author-Title”. You can, of course, add a genre, and so on. I checked the code for operability on a couple of thousand books available. It seems like it works.

The complete code itself looks like this:

from chardet.universaldetector import UniversalDetector #Определим кодировку файла

import re #Подключаем библиотеку для парсинга

import glob #Подключаем библиотеку для работы с файлами определенного расширения

import os #Подключаем библиотеку для работы с файловой системой

```
import random
```
```
 
```

path = str(input('Где находятся исходные файлы? : \n'))

```
regxp = '[\w-]+[\w:]'
```

result = re.findall(regxp, path) #Разбиваем введенный адрес на составляющие без обратного слеша

path = '\\\\'.join(result) #Добавляем двойной слеш после каждой папки (под формат Python)

```
 
```

print('Берем данные из:', path)

```
os.chdir(path)
```

print('Предстоит обработать книг:', len(glob.glob('*.fb2')))

```
for file in glob.glob('*.fb2'):
```

    print('\n\nОбрабатываем файл:',file)

```
    detector = UniversalDetector()
```

    with open(file, 'rb') as file_encoding:

```
        for line in file_encoding:
```
```
            detector.feed(line)
```
```
            if detector.done:
```
```
                break
```
```
        detector.close()
```

    file_encoding = str(detector.result['encoding'])

```
    print(file_encoding)
```
```
    if file_encoding == False:
```
```
        continue
```
```
    else:
```

        with open(file, 'r', encoding=file_encoding) as file_name:

```
            stroke = file_name.read()
```
```
            stroke = str(stroke)
```

            reg_genre = '<genre>(.+)</genre>'

            reg_title = '<book-title>(.+)</book-title>'

            reg_last_name = '<last-name>(.+)</last-name>'

            reg_first_name = 'first-name>(.+)</first-name>'

            reg_trial = '<title>Конец ознакомительного фрагмента.</p></title>'

            title = re.findall(reg_title, stroke)

```
            title = str(title)
```

            title = title.replace('\'', '').replace('\"', '').replace(':', '').replace('#', '').replace('(', ''). \

                    replace(')', '').replace('[', '').replace(']', '').replace('!', '').replace('?', '').replace('\\', '').\

                    replace('/', '').replace('.', '').replace('«', '').replace('»', '').replace(',', '').replace('-', '')

```
 
```

            last_name = re.findall(reg_last_name, stroke)

            print('Фамилия после поиска первой регуляркой: ', last_name )

            print('Тип фамилии:', type(last_name))

```
            if len(last_name) > 0:
```

                last_name = last_name[0]

                last_name = ''.join(last_name)

                last_name = str(last_name)

```
            else:
```

                last_name = str('БезФамилии')

            print('Фамилия после уборки лишних знаков: ', last_name)

            print('Тип фамилии:', type(last_name))

```
            reg_last_names = '^\w*'
```

            last_name = re.findall(reg_last_names, last_name)

            print('Фамилия после поиска второй регуляркой: ', last_name)

            print('Тип фамилии:', type(last_name))

            last_name = str(''.join(last_name))

```
 
```

            first_name = re.findall (reg_first_name, stroke)

            print('Результат имени после работы первой регулярки: ', first_name)

            print('Тип имени: ', type(first_name))

```
            if len(first_name) > 0:
```

                first_name = first_name[0]

                first_name = ''.join(first_name)

                first_name = str(first_name)

```
            else:
```

                first_name = str('БезИмени')

            print('Имя после уборки лишних знаков: ', first_name)

```
            reg_first_names = '^\w*'
```

            first_name = re.findall(reg_first_names, first_name)

            print('Имя после обработки второй регуляркой: ', first_name)

            print('Тип имени: ', type(first_name))

            first_name = str(''.join(first_name))

```
 
```

            trial_status = re.findall(reg_trial, stroke)

            print('Demo? ',trial_status)

            trial_status = ''.join(trial_status)

```
            print(trial_status)
```
```
            print(type(trial_status))
```

            print('Название:', ''.join(title))

            print('Фамилия: ', last_name)

```
            title = str(''.join(title))
```

            print('Имя: ', first_name)

```
 
```

        if trial_status == '<title><p>Конец ознакомительного фрагмента.</p></title>':

            print('Файл будет переименован: ', 'Demo' + ' ' + last_name  + ' ' + first_name + ' ' +  title + '.fb2')

            new_file_name = str('Demo' + ' ' + last_name  + ' ' + first_name + ' ' +  title + '.fb2')

```
            try:
```

                os.rename(str(file), new_file_name)

```
            except:
```

                os.rename(str(file), 'copy ' + new_file_name)

```
        else:
```

            print('файл будет переименован: ', last_name + ' ' +  first_name +  ' ' + title + '.fb2')

            new_file_name = str(last_name  + ' ' + first_name + ' ' +  title + '.fb2')

```
            try:
```

                os.rename(str(file), new_file_name)

```
            except:
```

                os.rename(str(file), 'copy ' + str(random.randrange(1, 10000)) + new_file_name)

```
 
```
```
print('Все сделано!')
```

The code is also available on GitHub by link.

And as always – in case of any questions and comments or even ideas – write to mail or Telegram/

Oleksiy Lavrynenko – PR, SMM, WEB

FB-Extractor – extract data from a .fb2 file

Like this:

Похожее