[OE2.0] m3u2bouquet Plugin

[Mafia_DZ]

m3u2bouquet Plugin

UPDATE

1.0.64

1) Fixed EPG event import for images without twisted.python.runtime.supportsThreads
2) In skins, instead of color aliases, colors are now set in #aarrggbb format to prevent crashes on prehistoric images
3) Fixed for VTi images ...
4) zh_CH locale added

[Mafia_DZ]

m3u2bouquet Plugin

UPDATE

1.0.66

1) Fixed skin loading for images with custom skins of this plugin
2) When creating "All channels bouquet" the name bouquet will match the name of the provider and will be created without the phrase "All channels-"
3) Added creation of the ***-diff-override.xml file that contains new broadcasts in the m3u-playlist of the provider in relation to the used ***-sort-override.xml. This file allows you to track changes in the provider's playlist. It is created only when new broadcasts appear in the m3u playlist. The data of this file can be used to manually edit (add) broadcasts to the current ***-sort-override.xml

[Mafia_DZ]

m3u2bouquet Plugin
Mod Dorik1972

UPDATE

18.07.2022

1.0.67

Added filter for unwanted categories. You can edit and define unwanted categories yourself in the "m3ufilter.conf" file. This file will appear in the plugin configuration folder after generating bouquets. In order to enable the filter, you need to enable the corresponding option in the IPTV provider card. By default, two sections are created in m3ufilter.conf for categories united by "semantic" value. The number of sections is not limited and can be created by the user according to his needs, by analogy with existing ones.

p.s. m3ufilter.conf logic can be extended to any reasonable functionality in the future.

[Mafia_DZ]

m3u2bouquet Plugin
Mod Dorik1972

UPDATE

1.0.68

1) Fixed Ukrainian locale
2) The logic of generating the ***-diff-override.xml file has been changed. Now, if a category in ***-sort-override.xml is set to enable="0", then new channels in it are not analyzed and are not included in the ***-diff-override.xml file. It is believed that if the user has deliberately disabled a category, then it makes no sense to analyze channel changes in it. Thus, the ***-diff-override.xml file will only include channels of those categories that are not in ***-sort-override.xml or are marked in it as enable="1"

[Mafia_DZ]

m3u2bouquet Plugin

Mod Dorik1972

UPDATE

v1.0.70

1) Bouquet filenames generated by this plugin have been changed
2) Reorganized the structure of folders and files in the plugin data folder
3) Updated all libraries used by this plugin to the latest versions available for shared use in Python 2/3
4) Added support for the JTV format (PDT and NDX files) for the EPG. This EPG format is used by some local IPTV providers. It is also quite popular in Poland. Tested on the following sources:

Teleguideinfo__http://www.teleguide.info/download/new3/jtv.zip
Iformula_______http://iformula.ru/IPTV/tvprogramm/jtv.zip
Triolan________http://triolan.tv/App_Files/jtv.zip
Matrixhome_____http://iptv.matrixhome.net/jtv/dn/epg_jtv.zip
2kom___________http://2kom.tv/jtv.zip
Idcmd__________http://iptv.idc.md/files/jtv.zip
Spark__________http://spark-tv.ru/jtv.zip
Avianetwork____http://avianetwork.ru/tv_list/jtv.zip
ProgramTV______http://programtv.ru/jtv.zip 

p.s. To upgrade to this version:

1) Backup config.xml from plugin data storage folder
2) Menu - Reset Bouquets - Yes
3) Install a new version of the plugin
4) Restore config.xml from backup
5) Create bouquets
6) Enjoy!

Thanks Dorik1972

[Mafia_DZ]

m3u2bouquet Plugin

Mod Dorik1972

UPDATE 28.08.2022

1.0.72

1) Fixed "database malformed" for DreamOS-based images. This error almost always occurred if you set "Start import EPG after loading bouquets" in the plugin settings. No more problems
2) Small reorganization of the code + added logging of what is happening =)

[Mafia_DZ]

m3u2bouquet Plugin

Mod Dorik1972

UPDATE 05.09.2022

1.0.73.1


(DreamOS special edition part 2)


Reading documentation - works wonders (https://www.sqlite.org/docs.html)
1) Changed SQLite server parameters on opening epg.db, thanks to which the speed of importing EPG events in new (fresh) epg.db has increased by 100% compared to the previous version (1.0.73)
2) Now only new events are added to the existing database, i.е. only those that are NOT in the existing EPG. Thanks to this logic, we have a 150-200% increase in the speed of importing events on the existing database compared to the previous version (1.0.73)
3) When "closing" the database after adding events, we do "VACUUM" which allows us to significantly reduce the size of the epg.db file, especially noticeable when the EPG file is > 100Mb
4) Fixed a theoretically possible error when adding an event with a short description (title) longer than 240 characters. Under certain circumstances, such events might not fall into the EPG database.


p.s. At the moment, the speed of importing XMLTV events on my DM900HD is almost comparable to the speed of importing the same events of the same XMLTV on VU+ Ultimo4K

[Mafia_DZ]

m3u2bouquet Plugin

Mod Dorik1972

UPDATE 15.09.2022

1.0.74.1


1) A bunch of little things have been fixed due to which some of the events from XMLTV could not get into the EPG.
2) Added "analysis" of the validity of received events from XMLTV. Now any "garbage" that occurs due to errors in the formation of XMLTV by the provider does not get into the EPG.
3) The logic of the XMLTV parser has been completely changed... now we analyze one event ahead... which makes it possible to form the correct event tuples for a group of channels.
Previously, events were parsed into the following "structure":

([service, service, ***], ((event))) 

Now so

          ([service, service, ***], ((event), (event), (event), ***)) 

This allows the full use of the enigma.eEPGCache (epgcache.cpp) C code if it supports the ImportEvents method. For a group of channels, a group of events is now transmitted, and not just one event as before... As a result, on the nodes "programme" ordered by "channel" in XMLTV, we get an increase in the speed of importing events.
4) Parsing the values of all tags of the "programme" node in XMLTV is now done in "one pass".
5) Added support for "multi-language" XMLTV ... and not only in the XMLTV parser, but also in import to epg.db for DreamOS...
Judging by the structure of the database (epg.db), this is clearly supported there (an analogy can be drawn with different audio tracks for the same broadcast). In OE versions<2.5 multilingual EPG is not supported and priority is given to events whose language matches the locale of your Enigma2
6) In SQL-wrapper (only for DreamOS) added "UPDATE" of event descriptions imported earlier ...
For example:
On Mon morning you imported EPG 3 days in advance and in it, for some channels, there were no descriptions, and on Mon evening - the provider updated its XMLTV and added descriptions ... so... now if you update the EPG again after that, for example on Tuesday morning, then the descriptions for existing events will be updated.
7) Returned back journal_mode = "DELETE" for SQLite. Now working with the SQL database is exactly the same as in the C code on DreamOS.
8) I changed the code so that I removed two files altogether... They turned out to be superfluous "crutches" ... Due to this, there is one less "intermediate" generator.
9) Added "pop-up" notifications... cool little stuff... will pop up in the upper right corner of the screen...
10) Fixed a bug with the appearance of channels marked as enabled="0" in the ***-diff-override.xml file in the "custom" sorting mode.
11) The logic of working with "hidden markers" has been completely removed. Now in userbouquets the strings "519:1" or "832:d" that are incomprehensible to many users will be removed.


ENJOY!


p.s. Special thanks to @YC78 for tests on DreamOS and an impressive donate

[Mafia_DZ]

m3u2bouquet Plugin

Mod Dorik1972

UPDATE 20.09.2022

1.0.75

1) Fixed an annoying typo in the code that caused a crash when trying to save the log file
2) Minor changes to the XML iterator, giving a gain of 1-2 seconds for every 100,000 records processed
3) Slightly updated the design of the regular skin. More strict and concise.
4) The algorithm for auto-selection of EPG events by channel name has been redesigned. Now, if after preliminary analysis no exact match is found among the candidates, the Damerau-Levenshtein algorithm for finding the greatest match based on an iterative version of the Wagner-Fischer algorithm is applied (this works if and only if the EPGurl link is set in the provider settings.) - Theory - Optimal Wagner-Fischer Algorithm For Approximate Strings Matching

[Mafia_DZ]

m3u2bouquet Plugin

Mod Dorik1972

UPDATE 13.12..2022

1.0.81.1
1) Increased user IP detection time.
2) Changed the request for obtaining ISO693-3 codes for DreamOS-based images