146 Commits
Author SHA1 Message Date
Joe Steele 26785e73b6 commit 2024-12-19 09:25:59 -05:00
Joe Steele 45a9ca04da Linting 2024-11-03 16:06:27 -05:00
Joe Steele 875d2f5c2b linting 2024-11-03 15:55:28 -05:00
Joe Steele f0f1eacfbd linting 2024-11-03 15:52:45 -05:00
Joe Steele 8005f47517 more linting 2024-11-03 12:59:42 -05:00
Joe Steele e5618abbe1 linting 2024-11-03 12:45:59 -05:00
Joe Steele 0d8f2dd565 linting 2024-11-03 12:44:08 -05:00
Joe Steele 3e400170b0 linting 2024-11-03 12:32:21 -05:00
Joe Steele e6aa6b6339 fixed posting to wordpress and addiition to database 2024-09-13 18:06:43 -04:00
Joe Steele eae7276147 fixed city state tags 2024-08-04 11:40:14 -04:00
Joe Steele 552927bdb6 small edits 2024-07-08 08:21:09 -04:00
Joe Steele 6773143e4f Huge work on database and wordpress updates 2024-07-08 08:01:21 -04:00
Joe Steele 73bb8564ca got montage renamed, uploaded and attached 2024-07-06 08:01:11 -04:00
Joe Steele 0e2d39ef64 working on tiktok and threads 2024-07-03 08:41:21 -04:00
Joe Steele b99e43f0d6 tiktok 2024-07-02 16:25:12 -04:00
Joe Steele 972edffd22 started tiktok 2024-07-02 15:58:20 -04:00
Joe Steele 7110b92de3 merge 2024-07-02 10:34:36 -04:00
Joe Steele f8b6200168 fixed instagram over 60 seconds 2024-07-02 09:03:11 -04:00
Joe Steele 99d7ac8d63 trying to sort of xls still 2024-07-02 06:55:46 -04:00
Joe Steele 80b506ff04 fixing xls 2024-07-01 09:05:22 -04:00
Joe Steele ac9f671cb2 commiting 2024-06-30 21:52:17 -04:00
Joe Steele c6c14afc6b Updated but still broken writing to excel 2024-06-30 21:48:06 -04:00
Joe Steele d774a207a0 Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-28 13:56:50 -04:00
Joe Steele 6e5d89cdb1 update 2024-06-28 13:56:42 -04:00
Joe Steele d8019d5565 resub 2024-06-28 08:58:25 -04:00
Joe Steele c1a1341c49 update excel 2024-06-27 13:19:32 -04:00
Joe Steele 663b88ab8b dedupr 2024-06-27 08:52:30 -04:00
Joe Steele 2ae3339a63 fixed getting all visit date into same format 2024-06-26 18:25:07 -04:00
Joe Steele 5dd64d5d5e Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-26 16:11:34 -04:00
Joe Steele 8ffb9f46a8 resync 2024-06-26 16:11:28 -04:00
Joe Steele 2b33ff35c8 fix visit date (seems to work) 2024-06-26 16:02:27 -04:00
Joe Steele 8a9c3e0b76 added test for visited date starting with string 2024-06-26 15:35:36 -04:00
Joe Steele a26b334571 cleanup 2024-06-26 12:24:21 -04:00
Joe Steele 70b7b4ae80 Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-25 18:12:09 -04:00
Joe Steele 50612bbc02 fix dimensions of xls sheet 2024-06-25 18:11:52 -04:00
Joe Steele 50d391b9e4 linting 2024-06-25 16:29:31 -04:00
Joe Steele 08e08f4b02 more linting 2024-06-25 15:39:30 -04:00
Joe Steele 6b9ab27651 linting 2024-06-25 10:21:44 -04:00
Joe Steele 357bad0e1d Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-25 09:15:25 -04:00
Joe Steele c6af16b186 reupping 2024-06-25 09:14:51 -04:00
Joe Steele f7067ade72 working on date information for posts with no pics 2024-06-25 08:18:55 -04:00
Joe Steele 7992b28036 added visitdate 2024-06-25 01:09:42 -04:00
Joe Steele 3c44e940e2 started rewriting post to wordpress 2024-06-24 09:41:25 -04:00
Joe Steele 6361f21f8a changed one more instance of timeout 2024-06-21 08:24:11 -04:00
Joe Steele 59b9d2ec89 Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-20 21:12:39 -04:00
Joe Steele a774e538b5 bringing database up to date 2024-06-20 21:11:12 -04:00
Joe Steele 2c6051a35a more linting 2024-06-20 14:48:00 -04:00
Joe Steele 42b1fe50d4 changed request timeout to be globally configurable in env file 2024-06-20 11:55:16 -04:00
Joe Steele ebd30a9979 added ability to force wordpress update for all posts 2024-06-20 07:59:26 -04:00
Joe Steele 4b271afd7b change timeout for wordpress 2024-06-20 07:01:10 -04:00
Joe Steele 9e48f67e57 merged codbase and wrote some new database writing 2024-06-19 22:47:02 -04:00
Joe Steele 7ec229de9f Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-19 22:18:35 -04:00
Joe Steele 30b7ce183b more updates 2024-06-19 22:18:30 -04:00
Joe Steele fddb2656db fixed xls rows 2024-06-19 22:12:39 -04:00
Joe Steele ce980774ab working tiktok 2024-06-19 22:10:11 -04:00
Joe Steele 239c3a5434 working on xls transformation 2024-06-19 08:02:43 -04:00
Joe Steele a8c86b45ec Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-18 17:39:44 -04:00
Joe Steele 37f4e61840 test 2024-06-18 17:39:16 -04:00
Joe SteeleandGitHub e299389d65 Update pylint.yml 2024-06-18 15:36:05 -04:00
Joe Steele 8b14969869 databse writes 2024-06-18 12:59:54 -04:00
Joe Steele 41cd6ead52 Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-18 08:01:08 -04:00
Joe Steele 6ba0adfa61 working on writing to DB and excel 2024-06-18 08:01:02 -04:00
Joe SteeleandGitHub 4e7475733e Update pylint.yml 2024-06-17 23:30:20 -04:00
Joe Steele 9cf9fd3697 Merge branch '3.0' of https://github.com/timberjoegithub/GoogleScrape into 3.0 2024-06-17 23:27:33 -04:00
Joe Steele a08d22efc6 more linting 2024-06-17 23:27:22 -04:00
Joe SteeleandGitHub 0659dfbd22 Update pylint.yml 2024-06-17 23:19:14 -04:00
Joe Steele e0d3857163 more linting 2024-06-17 23:14:15 -04:00
Joe Steele 5df6f6bd2c fixing stuff that broke in reorganization 2024-06-17 20:04:27 -04:00
Joe Steele 55dfec90df more linting 2024-06-17 17:27:39 -04:00
Joe Steele 058477d87f formatting for linting 2024-06-17 16:57:48 -04:00
Joe Steele 9f480185cd added docstrings 2024-06-17 15:06:34 -04:00
Joe Steele 5385488e01 futher pushed to DB for config 2024-06-17 14:33:58 -04:00
Joe Steele b35e9e093d more updates 2024-06-17 09:27:06 -04:00
Joe Steele 2c16c348c7 cleaning up processing reviews 2024-06-16 23:10:44 -04:00
Joe Steele de67bb2e91 cutting down functions 2024-06-16 22:51:42 -04:00
Joe Steele 3e05188aea fixed socialpost function to work for everything 2024-06-16 22:07:20 -04:00
Joe Steele df0dce5b50 Updated trues to 1's 2024-06-16 17:19:33 -04:00
Joe Steele 9cd8c248dd Fork 3.0 2024-06-15 17:16:54 -04:00
Joe Steele c6924ce3e5 cleanup - linting 2024-06-15 08:15:14 -04:00
Joe Steele cb5757ae13 upfates 2024-06-14 23:09:51 -04:00
Joe Steele 7f25a9de4d twitter working now (although it skips invalid 2024-06-14 16:23:08 -04:00
Joe Steele 0d6aac15f3 fixed twitter 2024-06-14 15:53:10 -04:00
Joe Steele c06d35e0e6 fixing some wordpress posting problems 2024-06-14 13:59:15 -04:00
Joe Steele 274b7698c6 Adding links to Facebook and cleaning up twitter 2024-06-14 13:42:15 -04:00
Joe Steele 49b2f22efc update 2024-06-14 10:14:16 -04:00
Joe Steele efe726aed9 fixed twitter 2024-06-14 08:49:47 -04:00
Joe Steele 697e59f260 fixed more twitter post problems 2024-06-13 23:16:00 -04:00
Joe Steele 4e44c93f64 update Exceptions 2024-06-13 22:05:24 -04:00
Joe Steele ad5ab9ce48 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-13 21:26:04 -04:00
Joe Steele 24975dbc38 update 2024-06-13 21:25:52 -04:00
timberjoegithub 2bc34775c0 dint know 2024-06-13 15:38:25 -04:00
Joe Steele 59cb54c6c3 fixed twitter 2024-06-13 11:58:31 -04:00
Joe Steele 9dd2920ff2 removed link to wordpress site from being posted to wordpress site 2024-06-13 08:59:16 -04:00
Joe Steele 9dac335681 Added link to website to wordpress 2024-06-13 08:57:57 -04:00
Joe Steele cbc21642b1 Added business url to Twitter 2024-06-13 08:54:23 -04:00
Joe Steele e2e6175452 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-13 08:51:08 -04:00
Joe Steele dfb0d4b6f6 added link to wordpress review to Twitter 2024-06-13 08:49:42 -04:00
Joe Steele d4c10e064d more comments 2024-06-12 22:18:47 -04:00
Joe Steele eadbdbf648 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-12 22:07:46 -04:00
Joe Steele 30a501edb8 added comments 2024-06-12 22:06:53 -04:00
Joe Steele 8b42fda122 more docstrings 2024-06-12 14:30:23 -04:00
Joe Steele 62fc5307f3 Updated docstrings 2024-06-12 14:24:44 -04:00
Joe Steele c753dbcd86 Linting 2024-06-12 14:01:36 -04:00
Joe Steele 16c3c75ddc added requirements 2024-06-12 13:15:39 -04:00
Joe Steele 8f2897bcb3 add new lines 2024-06-12 12:25:51 -04:00
Joe Steele 53350d0c1d more formatting 2024-06-12 09:48:53 -04:00
Joe Steele ee0110eae9 working on wpurl, need to clean DB, got dup records 2024-06-11 17:33:52 -04:00
Joe Steele 09d694d937 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-11 15:49:33 -04:00
Joe Steele b69bb36c24 working on wpurl 2024-06-11 15:47:19 -04:00
Joe Steele 3e9a2b9fc3 worked on making wpurl write correctly to DB 2024-06-11 15:41:55 -04:00
Joe Steele c91c1b1465 move inactive code to side 2024-06-11 13:25:30 -04:00
Joe Steele fe23ebba62 Moved all inactive code to the side 2024-06-11 13:24:57 -04:00
Joe Steele 0b33c745e7 Cleaning up more 2024-06-11 10:29:04 -04:00
Joe Steele f16290a0d0 Fixed database updates 2024-06-10 21:20:47 -04:00
Joe Steele ce825d3ddb Fixed problems with wordpress adds to database 2024-06-10 20:29:53 -04:00
Joe Steele 1c8f2af062 oo 2024-06-10 15:32:51 -04:00
Joe Steele 83ce83f3f8 more cleaning 2024-06-10 15:14:14 -04:00
Joe Steele caace8be66 Major cleanup and moving code around. Likely to break something 2024-06-10 14:48:51 -04:00
Joe Steele e6273febe5 Had some string compares against ints 2024-06-10 12:12:41 -04:00
Joe Steele f3794f3472 new fixing 2024-06-10 11:02:01 -04:00
Joe Steele 9590a3ef28 added comments 2024-06-09 19:26:13 -04:00
Joe Steele fb22ae2707 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-09 19:23:46 -04:00
Joe Steele db5878aca4 see previous 2024-06-09 19:21:49 -04:00
Joe Steele d65dd91841 Move updates to database and add new columns for cool stuff 2024-06-09 19:21:42 -04:00
timberjoegithub 765e651116 Update 2024-06-07 14:19:35 -04:00
Joe Steele 8d4fa44a1b Moved accounting to database 2024-06-07 12:34:09 -04:00
Joe Steele 88ae7df0eb Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-07 10:49:04 -04:00
Joe Steele 6a01354521 successfully writing database status for weg 2024-06-07 08:15:42 -04:00
timberjoegithub 40bbc1b37d fixed database 2024-06-07 07:02:00 -04:00
Joe Steele 368da2609e added columns for different socials 2024-06-07 06:36:27 -04:00
Joe Steele fe703c9c65 update database 2024-06-06 17:33:51 -04:00
Joe Steele 484ce73ac2 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-05 09:10:06 -04:00
Joe Steele 5f33cfc912 resync 2024-06-05 09:09:39 -04:00
Joe Steele 6aa64288c5 more linting 2024-06-05 08:32:55 -04:00
Joe Steele 4def1bc002 more linting 2024-06-05 08:30:45 -04:00
Joe Steele ad3645fbe0 more linting 2024-06-05 08:26:22 -04:00
Joe Steele edf0678a49 fixing linting problems 2024-06-05 08:00:09 -04:00
Joe Steele 62d70040c8 Merge branch 'main' of https://github.com/timberjoegithub/GoogleScrape 2024-06-04 08:29:41 -04:00
Joe Steele f434214eff UPDATE 2024-06-04 08:26:34 -04:00
Joe Steele 467f22c1b6 jj 2024-06-03 14:41:07 -04:00
Joe Steele 53f7ae3c7e Twitter v2 updates 2024-06-03 12:51:48 -04:00
Joe Steele bd2491c406 fixing xtwitter 2024-06-02 21:38:49 -04:00
timberjoegithub 68dba21de7 initial add of X/twitter 2024-06-02 18:59:22 -04:00
timberjoegithub 9b26c7ccb7 cv 2024-05-30 11:41:56 -04:00
timberjoegithub 3f6133db0d out of fync 2024-05-30 11:40:43 -04:00
Joe Steele 6996d9b9e5 resync 2024-05-29 10:05:07 -04:00
5 changed files with 2165 additions and 867 deletions
+2 -2
View File
@@ -7,7 +7,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python-version: ["3.8", "3.9", "3.10"]
python-version: ["3.11"]
steps:
- uses: actions/checkout@v3
- name: Set up Python ${{ matrix.python-version }}
@@ -20,4 +20,4 @@ jobs:
pip install pylint
- name: Analysing the code with pylint
run: |
pylint $(git ls-files '*.py')
pylint $(git ls-files '*.py') --output=lint.txt || true
+4 -1
View File
@@ -18,4 +18,7 @@ Facepost.py
config/
env.py
social.py
.vscode/
.vscode/
googleinfo.py
social.examples.py
debug.log
+22 -13
View File
@@ -1,13 +1,22 @@
autopep8==1.5.7
et-xmlfile==1.1.0
numpy==1.21.2
openpyxl==3.0.9
pandas==1.3.3
pkg_resources==0.0.0
pycodestyle==2.7.0
python-dateutil==2.8.2
pytz==2021.1
selenium==3.141.0
six==1.16.0
toml==0.10.2
urllib3==1.26.6
autopep8
et-xmlfile
numpy
openpyxl
pandas
pycodestyle
python-dateutil
pytz
selenium
six
toml
urllib3
aiohttp
instagrapi
jsonpickle
tweepy
sqlalchemy
googlemaps
moviepy
mysqlclient
mysql-connector-python
pymysql
+2108 -844
View File
File diff suppressed because it is too large Load Diff
+29 -7
View File
@@ -1,23 +1,45 @@
"""
Sends a text message to a phone number through the specified carrier.
Args:
phone_number_inside (str): The phone number to send the message to.
carrier_inside (str): The carrier of the phone number.
message_inside (str): The message content to be sent.
Returns:
None
"""
import smtplib
import sys
CARRIERS = {
"att": "@mms.att.net",
"tmobile": "@tmomail.net",
"verizon": "@vtext.com",
"sprint": "@messaging.sprintpcs.com"
}
EMAIL = "EMAIL"
PASSWORD = "PASSWORD"
def send_message(phone_number, carrier, message):
recipient = phone_number + CARRIERS[carrier]
def send_message(phone_number_inside, carrier_inside, message_inside):
"""
Sends a text message to a phone number through the specified carrier.
Args:
phone_number_inside (str): The phone number to send the message to.
carrier_inside (str): The carrier of the phone number.
message_inside (str): The message content to be sent.
Returns:
None
"""
recipient = phone_number_inside + CARRIERS[carrier_inside]
auth = (EMAIL, PASSWORD)
server = smtplib.SMTP("smtp.gmail.com", 587)
server.starttls()
server.login(auth[0], auth[1])
server.sendmail(auth[0], recipient, message)
server.sendmail(auth[0], recipient, message_inside)
if __name__ == "__main__":
if len(sys.argv) < 4:
@@ -26,4 +48,4 @@ if __name__ == "__main__":
phone_number = sys.argv[1]
carrier = sys.argv[2]
message = sys.argv[3]
send_message(phone_number, carrier, message)
send_message(phone_number, carrier, message)