From: Muhammad Rizki <[email protected]>
To: Ammar Faizi <[email protected]>
Cc: Muhammad Rizki <[email protected]>,
GNU/Weeb Mailing List <[email protected]>
Subject: [PATCH v1 05/18] Add utility functions for /add_atom
Date: Fri, 29 Jul 2022 07:40:14 +0700 [thread overview]
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
Add some utility functions for /add_atom command in the scraper/utils.py
and call it in packages/plugins/add_atom.py
Signed-off-by: Muhammad Rizki <[email protected]>
---
daemon/packages/plugins/manage_atom.py | 20 ++++++++++----------
daemon/scraper/utils.py | 15 +++++++++++++++
2 files changed, 25 insertions(+), 10 deletions(-)
diff --git a/daemon/packages/plugins/manage_atom.py b/daemon/packages/plugins/manage_atom.py
index eca3a60..a10318f 100644
--- a/daemon/packages/plugins/manage_atom.py
+++ b/daemon/packages/plugins/manage_atom.py
@@ -6,17 +6,17 @@
from pyrogram.types import Message
from pyrogram import filters
from packages import DaemonClient
+from scraper import utils
@DaemonClient.on_message(
- filters.command("add_atom") &
- filters.chat(["kiizuah", "nekoha", -1001673279485])
+ filters.command("add_atom") &
+ filters.chat(["kiizuah", "nekoha", -1001673279485])
)
async def add_atom_url(c: DaemonClient, m: Message):
- pass
- # text = utils.remove_command(m.text)
- # if not utils.is_atom_url(text):
- # return
-
- # ###
- # ### TODO: Muhammad Rizki: Add atom url into the database
- # ###
+ text = utils.remove_command(m.text)
+ if not utils.is_atom_url(text):
+ return
+
+ ###
+ ### TODO: Muhammad Rizki: Add atom url into the database
+ ###
diff --git a/daemon/scraper/utils.py b/daemon/scraper/utils.py
index 30efb7b..f7de5ba 100644
--- a/daemon/scraper/utils.py
+++ b/daemon/scraper/utils.py
@@ -12,6 +12,7 @@ import uuid
import os
import re
import shutil
+import httpx
def get_email_msg_id(mail):
@@ -231,3 +232,17 @@ def extract_email_msg_id(msg_id):
return None
return ret.group(1)
+
+async def is_atom_url(text: str):
+ try:
+ async with httpx.AsyncClient() as ses:
+ res = await ses.get(text)
+ mime = res.headers.get("Content-Type")
+
+ return mime == "application/atom+xml"
+ except: return False
+
+def remove_command(text: str):
+ txt = text.split(" ")
+ txt = text.replace(txt[0] + " ","")
+ return txt
--
Muhammad Rizki
next prev parent reply other threads:[~2022-07-29 0:41 UTC|newest]
Thread overview: 45+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-07-29 0:40 [PATCH v1 00/18] New feature to handle atom URLs and broadcast Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 01/18] Add atom_broadcast.sql Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 02/18] Add ATOM_URLS and BROADCAST_CHAT methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 03/18] Fix MySQL InternalError: Unread result found Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 04/18] Create /add_atom command Muhammad Rizki
2022-07-29 0:40 ` Muhammad Rizki [this message]
2022-07-29 0:40 ` [PATCH v1 06/18] Refactor database methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 07/18] Add insert_atom() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 08/18] Rename admin.py to debugger.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 09/18] Add delete_atom() function in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 10/18] Add utility function buton_numbers() Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 11/18] Move bot commands related files to packages/plugins/commands/ Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 12/18] Add del_atom callback query Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 13/18] Add insert_broadcast() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 14/18] Add delete_broadcast() " Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 15/18] Create /add_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 16/18] Add create_chat_link() function Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 17/18] Add /del_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 18/18] Add del_chat callback query Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 00/18] New feature to handle atom URLs and broadcast Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 01/18] Add atom_broadcast.sql Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 02/18] Add ATOM_URLS and BROADCAST_CHAT methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 03/18] Fix MySQL InternalError: Unread result found Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 04/18] Create /add_atom command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 05/18] Add utility functions for /add_atom Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 06/18] Refactor database methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 07/18] Add insert_atom() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 08/18] Rename admin.py to debugger.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 09/18] Add delete_atom() function in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 10/18] Add utility function buton_numbers() Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 11/18] Move bot commands related files to packages/plugins/commands/ Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 12/18] Add del_atom callback query Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 13/18] Add insert_broadcast() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 14/18] Add delete_broadcast() " Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 15/18] Create /add_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 16/18] Add create_chat_link() function Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 17/18] Add /del_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 18/18] Add del_chat callback query Muhammad Rizki
-- strict thread matches above, loose matches on Subject: below --
2022-07-27 2:46 [PATCH v1 00/18] New feature to handle atom URLs and broadcast Muhammad Rizki
2022-07-27 2:46 ` [PATCH v1 05/18] Add utility functions for /add_atom Muhammad Rizki
2022-07-27 15:09 ` Ammar Faizi
[not found] ` <[email protected]>
2022-07-28 4:06 ` Ammar Faizi
2022-08-10 22:05 ` Ammar Nofan Faizi
2022-08-11 2:41 ` Muhammad Rizki
2022-08-11 2:47 ` Ammar Nofan Faizi
2022-08-11 2:56 ` Ammar Nofan Faizi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
[email protected] \
[email protected] \
[email protected] \
[email protected] \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox