From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on gnuweeb.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=5.0 tests=ALL_TRUSTED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,NO_DNS_FOR_FROM,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.6 Received: from localhost.localdomain (unknown [101.128.125.123]) by gnuweeb.org (Postfix) with ESMTPSA id 1BB9A8060C; Sat, 22 Oct 2022 06:52:05 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gnuweeb.org; s=default; t=1666421527; bh=X6J3/Cn2qqgO/LASNWPvpti+YfWINt+IGDmXlLNqs0M=; h=From:To:Cc:Subject:Date:From; b=XJNCkXVJpolhRXqap2qlvI2Fpgdz8rHb9J/yol/NmsPjYPepgJyHFvUG4Ccv5arVO AX3yEKR6f/Hv+L0MaD526MGw4Br2tBOdqsK/IEWvrdP1ZjwTq7nGcieOosOUdPsI4R 7plggwNYNaxB3r38lsxRMiYMDSqHZgEflgZPrKESkXPy9Jwg6N9j3wJU77HUsjrCO2 2Z9nGC/n5b6q+rTWBRliTXZ26BvObHlkP6TCS+BAmIf0ybJnSOs4x/4JEAVNZG6WPP FrJSUyqMljHAekSTDZIcFVYDR+lhrk+MlBHZdmNewdZNFxfQIGh6Q9VW4DHjQXzaLY fV/mADQJqGIaQ== From: Muhammad Rizki To: Ammar Faizi Cc: Muhammad Rizki , Alviro Iskandar Setiawan , GNU/Weeb Mailing List Subject: [PATCH v4 0/9] Fix some bugs and add some features Date: Sat, 22 Oct 2022 13:51:40 +0700 Message-Id: <20221022065149.865-1-kiizuha@gnuweeb.org> X-Mailer: git-send-email 2.34.1.windows.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: Hi sir, This is v4 revision of fix some bugs and add some features. This series is to fix This series is to fix some bugs, improve some codes, add some new features and add enumeration. These bugs should have been fixed now, and the email file attachments should have been removed after all attachments have been sent. Known bugs: 1. Email payload extraction result become unicode if the email payload contain non-UTF8 characters like chinese, japanese, and similar like that. 2. remove_patch() doesn't remove all file attachments properly. Improvements: 1. Improve remove_patch() to make it all file attachments removed after sending them. 2. Fix `/lore {raw atom url}` to add a "telegram" onto the create_template() platform parameter. 3. Improvement on extract_body() to ignore whenever the email contain text/html content-type and use the email library function to get the header value. New features: 1. Add send_text_mail_interaction() for the `/lore {raw atom url}` slash command. 2. Add send_patch_mail_interaction() for the `/lore {raw atom url}` slash command. 3. Add `/lore {raw atom url}` slash command. 4. Platform class enumeration There are 9 patches in this series: - Patch 1 is to add send_text_mail_interaction() - Patch 2 is to add send_patch_mail_interaction() - Patch 3 is to add `/lore` slash command - Patch 4 is to improve remove_patch() code to make it more stable - Patch 5 is to add manage_payload() for manage email payload extraction - Patch 6 is to fix the Telegram `/lore` command - Patch 7 is to improve extract_body() to ignore text/html content-type - Patch 8 is to add initial Platform class enumeration - Patch 9 is to use the created Platform class enumeration How to use: 1. Execute the db.sql file in the daemon directory, 2. Setup .env file, the example is there with suffix .example, this file name must remove the suffix name .example, 3. Set up the config.py in each bot directory, such as dscord and telegram. The example is there with suffix .example & the file name must remove suffix name .example, 4. Run `pip3 install -r requirements.txt` in each bot directory, 5. STORAGE_DIR env value must `storage` to make it work fine, 6. Run the bot by `python3 dc.py` or `python3 tg.py`. Tested and works, what do you think with this patch? ## Changelog v3 -> v4: - Fix the decode error `invalid start byte` - Rename manage_payload() to get_decoded_payload() - Use charset to decode the payload - Use the email library function to get the header value v2 -> v3: - Add Platform class enumeration - Use the old one of fix_utf8_char() instead - Add Content-Transfer-Encoding handler in manage_payload() v1 -> v2: - Remove re.sub() in the fix_utf8_char() when set unescape to True - Add if statement logic to ignore text/html in the extract_body() Signed-off-by: Muhammad Rizki --- Muhammad Rizki (9): discord: Add send_text_mail_interaction() discord: Add send_patch_mail_interaction() discord: Add get lore mail slash command atom: Improve remove_patch() atom: add get_decoded_payload() telegram: Fix get lore command atom: Improve extract_body() enum: Add Platform enumeration enum: Use the created Platform class enumeration daemon/atom/utils.py | 61 ++++++++++++------- daemon/dscord/gnuweeb/client.py | 26 +++++++- .../plugins/slash_commands/__init__.py | 2 + .../plugins/slash_commands/get_lore_mail.py | 40 ++++++++++++ daemon/dscord/mailer/listener.py | 7 ++- daemon/enums/__init__.py | 1 + daemon/enums/base.py | 9 +++ daemon/enums/platform.py | 7 +++ daemon/telegram/mailer/listener.py | 7 +-- daemon/telegram/packages/client.py | 3 +- .../packages/plugins/commands/scrape.py | 7 +-- 11 files changed, 136 insertions(+), 34 deletions(-) create mode 100644 daemon/dscord/gnuweeb/plugins/slash_commands/get_lore_mail.py create mode 100644 daemon/enums/__init__.py create mode 100644 daemon/enums/base.py create mode 100644 daemon/enums/platform.py base-commit: d9b20dab81202b93f48d5365ad680796e5839d80 -- Muhammad Rizki