From: Muhammad Rizki <[email protected]>
To: Ammar Faizi <[email protected]>
Cc: Muhammad Rizki <[email protected]>,
GNU/Weeb Mailing List <[email protected]>
Subject: [PATCH v2 02/18] Add ATOM_URLS and BROADCAST_CHAT methods
Date: Fri, 29 Jul 2022 07:40:30 +0700 [thread overview]
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
I decided to add ATOM_URLS and BROADCAST_CHAT methods to get their
content in database which will be handle in scraper/bot.py
Signed-off-by: Muhammad Rizki <[email protected]>
---
daemon/scraper/bot.py | 17 ++++-------------
daemon/scraper/db.py | 21 +++++++++++++++++++++
2 files changed, 25 insertions(+), 13 deletions(-)
diff --git a/daemon/scraper/bot.py b/daemon/scraper/bot.py
index bc9d575..c475e34 100644
--- a/daemon/scraper/bot.py
+++ b/daemon/scraper/bot.py
@@ -21,16 +21,6 @@ class BotMutexes():
class Bot():
- ATOM_URLS = [
- "https://lore.kernel.org/io-uring/new.atom",
- "https://lore.kernel.org/linux-sgx/new.atom",
- ]
-
- TG_CHAT_IDS = [
- "kiizuah"
- ]
-
-
def __init__(self, client: DaemonClient, sched: AsyncIOScheduler,
scraper: Scraper, mutexes: BotMutexes, conn):
self.client = client
@@ -55,7 +45,7 @@ class Bot():
async def __run(self):
print("[__run]: Running...")
- for url in self.ATOM_URLS:
+ for url in self.db.get_atom_urls():
try:
await self.__handle_atom_url(url)
except:
@@ -80,10 +70,11 @@ class Bot():
async def __handle_mail(self, url, mail):
- for tg_chat_id in self.TG_CHAT_IDS:
+ chats = self.db.get_broadcast_chats()
+ for chat in chats:
async with self.mutexes.send_to_tg:
should_wait = await self.__send_to_tg(url, mail,
- tg_chat_id)
+ chat[1])
if should_wait:
await asyncio.sleep(1)
diff --git a/daemon/scraper/db.py b/daemon/scraper/db.py
index a79f041..321661f 100644
--- a/daemon/scraper/db.py
+++ b/daemon/scraper/db.py
@@ -112,3 +112,24 @@ class Db():
return None
return res[0]
+
+
+ def get_atom_urls(self):
+ q = """
+ SELECT atom_urls.url
+ FROM atom_urls
+ """
+ self.cur.execute(q)
+ urls = self.cur.fetchall()
+
+ return [u[0] for u in urls]
+
+
+ def get_broadcast_chats(self):
+ q = """
+ SELECT *
+ FROM broadcast_chats
+ """
+ self.cur.execute(q)
+
+ return self.cur.fetchall()
--
Muhammad Rizki
next prev parent reply other threads:[~2022-07-29 0:42 UTC|newest]
Thread overview: 39+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-07-29 0:40 [PATCH v1 00/18] New feature to handle atom URLs and broadcast Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 01/18] Add atom_broadcast.sql Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 02/18] Add ATOM_URLS and BROADCAST_CHAT methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 03/18] Fix MySQL InternalError: Unread result found Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 04/18] Create /add_atom command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 05/18] Add utility functions for /add_atom Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 06/18] Refactor database methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 07/18] Add insert_atom() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 08/18] Rename admin.py to debugger.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 09/18] Add delete_atom() function in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 10/18] Add utility function buton_numbers() Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 11/18] Move bot commands related files to packages/plugins/commands/ Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 12/18] Add del_atom callback query Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 13/18] Add insert_broadcast() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 14/18] Add delete_broadcast() " Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 15/18] Create /add_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 16/18] Add create_chat_link() function Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 17/18] Add /del_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v1 18/18] Add del_chat callback query Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 00/18] New feature to handle atom URLs and broadcast Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 01/18] Add atom_broadcast.sql Muhammad Rizki
2022-07-29 0:40 ` Muhammad Rizki [this message]
2022-07-29 0:40 ` [PATCH v2 03/18] Fix MySQL InternalError: Unread result found Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 04/18] Create /add_atom command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 05/18] Add utility functions for /add_atom Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 06/18] Refactor database methods Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 07/18] Add insert_atom() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 08/18] Rename admin.py to debugger.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 09/18] Add delete_atom() function in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 10/18] Add utility function buton_numbers() Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 11/18] Move bot commands related files to packages/plugins/commands/ Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 12/18] Add del_atom callback query Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 13/18] Add insert_broadcast() in scraper/db.py Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 14/18] Add delete_broadcast() " Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 15/18] Create /add_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 16/18] Add create_chat_link() function Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 17/18] Add /del_bc bot command Muhammad Rizki
2022-07-29 0:40 ` [PATCH v2 18/18] Add del_chat callback query Muhammad Rizki
-- strict thread matches above, loose matches on Subject: below --
2022-07-29 0:44 [PATCH v2 00/18] New feature to handle atom URLs and broadcast Muhammad Rizki
2022-07-29 0:44 ` [PATCH v2 02/18] Add ATOM_URLS and BROADCAST_CHAT methods Muhammad Rizki
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
[email protected] \
[email protected] \
[email protected] \
[email protected] \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox