sickprodigy/TubeArchivist-Scripts
1
0
Fork 0
Code Issues 2 Pull Requests Actions Packages Projects Releases Wiki Activity

New list being imported issues #1

New Issue
Open
opened 2025-10-21 22:04:52 -04:00 by sickprodigy · 6 comments
sickprodigy commented 2025-10-21 22:04:52 -04:00
Owner
Copy Link

Using https://archive.org/details/TerryDavisAltChannel
data, copied over to /cache
Got this error
Task failed: 'channel_id'

So i think i need to insert channel_id into .json or add 1 to the end of each file

Using https://archive.org/details/TerryDavisAltChannel data, copied over to /cache Got this error Task failed: 'channel_id' So i think i need to insert channel_id into .json or add 1 to the end of each file
sickprodigy commented 2025-10-21 22:23:28 -04:00
Author
Owner
Copy Link

Fixed with https://gitea.rcs1.top/sickprodigy/TubeArchivist-Scripts/src/branch/main/insert-channel-id-into-json.bash

but now new error

Task failed: join() argument must be str, bytes, or os.PathLike object, not 'bool'

think 1 of the files has a broken argument

Fixed with https://gitea.rcs1.top/sickprodigy/TubeArchivist-Scripts/src/branch/main/insert-channel-id-into-json.bash but now new error Task failed: join() argument must be str, bytes, or os.PathLike object, not 'bool' think 1 of the files has a broken argument
sickprodigy commented 2025-10-21 22:31:33 -04:00
Author
Owner
Copy Link

Imported some. Restarted tubearchivist in order to get working again. Get's to where home doesn't want to load after importing. So restart

Now this error

[2025-10-21 22:29:45,444: WARNING/ForkPoolWorker-4] manual import: {'media': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - afi9WKrI6zg.mp4', 'video_id': False, 'metadata': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - afi9WKrI6zg.info.json', 'thumb': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - afi9WKrI6zg.jpg', 'subtitle': []}

[2025-10-21 22:29:45,444: WARNING/ForkPoolWorker-4] manual import: {'media': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.webm', 'video_id': False, 'metadata': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.info.json', 'thumb': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.jpg', 'subtitle': ['/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.en.vtt']}

[2025-10-21 22:29:45,445: WARNING/ForkPoolWorker-4] manual import: {'media': False, 'video_id': False, 'metadata': False, 'thumb': False, 'subtitle': ['/cache/import/TerryA.Davis-20130328-TempleosCompiler_assemblerCodeWalk-thru-Yjflviky2gq.en.vtt']}

[2025-10-21 22:29:45,445: WARNING/ForkPoolWorker-4] manual import: {'media': False, 'video_id': False, 'metadata': False, 'thumb': '/cache/import/TerryA.Davis-20130426-TempleosGames-Chessnet-6tuxweejnfi.jpg', 'subtitle': []}

[2025-10-21 22:29:45,451: WARNING/ForkPoolWorker-4] id extraction failed from filename: /cache/import/Terry A. Davis - 20121205 - TempleOS User Interface Tutorial Part 2 - eZEEAmTgFy0.mkv

[2025-10-21 22:29:45,456: WARNING/ForkPoolWorker-4] 452ac230-45d7-4dfc-a110-6171708dc4c3 Failed callback

[2025-10-21 22:29:45,463: ERROR/ForkPoolWorker-4] Task manual_import[452ac230-45d7-4dfc-a110-6171708dc4c3] raised unexpected: TypeError("join() argument must be str, bytes, or os.PathLike object, not 'bool'")

Traceback (most recent call last):

  File "/root/.local/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task

    R = retval = fun(*args, **kwargs)

                 ^^^^^^^^^^^^^^^^^^^^

  File "/root/.local/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__

    return self.run(*args, **kwargs)

           ^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/app/task/tasks.py", line 227, in run_manual_import

    ImportFolderScanner(task=self).scan()

  File "/app/appsettings/src/manual.py", line 55, in scan

    self.process_videos()

  File "/app/appsettings/src/manual.py", line 140, in process_videos

    self._detect_youtube_id(current_video)

  File "/app/appsettings/src/manual.py", line 174, in _detect_youtube_id

    youtube_id = self._extract_id_from_json(current_video["metadata"])

                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/app/appsettings/src/manual.py", line 199, in _extract_id_from_json

    json_path = os.path.join(self.CACHE_DIR, "import", json_file)

                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "<frozen posixpath>", line 90, in join

  File "<frozen genericpath>", line 152, in _check_arg_types

TypeError: join() argument must be str, bytes, or os.PathLike object, not 'bool'

[2025-10-21 22:29:45,463: WARNING/ForkPoolWorker-4] 452ac230-45d7-4dfc-a110-6171708dc4c3 return callback

Language set to en

[2025-10-21 22:29:45,464: DEBUG/ForkPoolWorker-4] Language set to en
Imported some. Restarted tubearchivist in order to get working again. Get's to where home doesn't want to load after importing. So restart Now this error ``` [2025-10-21 22:29:45,444: WARNING/ForkPoolWorker-4] manual import: {'media': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - afi9WKrI6zg.mp4', 'video_id': False, 'metadata': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - afi9WKrI6zg.info.json', 'thumb': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - afi9WKrI6zg.jpg', 'subtitle': []} [2025-10-21 22:29:45,444: WARNING/ForkPoolWorker-4] manual import: {'media': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.webm', 'video_id': False, 'metadata': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.info.json', 'thumb': '/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.jpg', 'subtitle': ['/cache/import/Terry A. Davis - 20170328 - TempleOS - Terry A. Davis Live Stream - rrQWiL_jho0.en.vtt']} [2025-10-21 22:29:45,445: WARNING/ForkPoolWorker-4] manual import: {'media': False, 'video_id': False, 'metadata': False, 'thumb': False, 'subtitle': ['/cache/import/TerryA.Davis-20130328-TempleosCompiler_assemblerCodeWalk-thru-Yjflviky2gq.en.vtt']} [2025-10-21 22:29:45,445: WARNING/ForkPoolWorker-4] manual import: {'media': False, 'video_id': False, 'metadata': False, 'thumb': '/cache/import/TerryA.Davis-20130426-TempleosGames-Chessnet-6tuxweejnfi.jpg', 'subtitle': []} [2025-10-21 22:29:45,451: WARNING/ForkPoolWorker-4] id extraction failed from filename: /cache/import/Terry A. Davis - 20121205 - TempleOS User Interface Tutorial Part 2 - eZEEAmTgFy0.mkv [2025-10-21 22:29:45,456: WARNING/ForkPoolWorker-4] 452ac230-45d7-4dfc-a110-6171708dc4c3 Failed callback [2025-10-21 22:29:45,463: ERROR/ForkPoolWorker-4] Task manual_import[452ac230-45d7-4dfc-a110-6171708dc4c3] raised unexpected: TypeError("join() argument must be str, bytes, or os.PathLike object, not 'bool'") Traceback (most recent call last): File "/root/.local/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task R = retval = fun(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^ File "/root/.local/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__ return self.run(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/task/tasks.py", line 227, in run_manual_import ImportFolderScanner(task=self).scan() File "/app/appsettings/src/manual.py", line 55, in scan self.process_videos() File "/app/appsettings/src/manual.py", line 140, in process_videos self._detect_youtube_id(current_video) File "/app/appsettings/src/manual.py", line 174, in _detect_youtube_id youtube_id = self._extract_id_from_json(current_video["metadata"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/appsettings/src/manual.py", line 199, in _extract_id_from_json json_path = os.path.join(self.CACHE_DIR, "import", json_file) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "<frozen posixpath>", line 90, in join File "<frozen genericpath>", line 152, in _check_arg_types TypeError: join() argument must be str, bytes, or os.PathLike object, not 'bool' [2025-10-21 22:29:45,463: WARNING/ForkPoolWorker-4] 452ac230-45d7-4dfc-a110-6171708dc4c3 return callback Language set to en [2025-10-21 22:29:45,464: DEBUG/ForkPoolWorker-4] Language set to en ```
sickprodigy commented 2025-10-21 22:35:42 -04:00
Author
Owner
Copy Link

cleaned up extra files not needed, still didn't work, noticed a lot of files in /cache/import don't even have .info.json next to them and i just deleted the metadata files..

well like 13 or so, so maybe if I just import what does have it and move on maybe, try it later. got some to import already.

cleaned up extra files not needed, still didn't work, noticed a lot of files in /cache/import don't even have .info.json next to them and i just deleted the metadata files.. well like 13 or so, so maybe if I just import what does have it and move on maybe, try it later. got some to import already.
sickprodigy commented 2025-10-22 18:24:42 -04:00
Author
Owner
Copy Link

Manual video import

Task failed: join() argument must be str, bytes, or os.PathLike object, not 'bool'

Manual video import Task failed: join() argument must be str, bytes, or os.PathLike object, not 'bool'
sickprodigy commented 2025-10-22 19:10:34 -04:00
Author
Owner
Copy Link

alright went in reverse, figured out a lot of duplicates were in .mkv, removed those and had to create a look a like file to use with 1 last video that was missing it's data. Now waiting for the other videos to finish

alright went in reverse, figured out a lot of duplicates were in .mkv, removed those and had to create a look a like file to use with 1 last video that was missing it's data. Now waiting for the other videos to finish
sickprodigy commented 2025-10-22 19:56:57 -04:00
Author
Owner
Copy Link

This time running

  1. ./move-find-id-to-end-filename.bash
  2. ./create-json-alongside-each-file.bash
  3. ./insert-id-into-json.bash
  4. ./insert-title-into-json.bash
  5. ./insert-date-into-json.bash

Worked out great.

This time running 1. ./move-find-id-to-end-filename.bash 2. ./create-json-alongside-each-file.bash 3. ./insert-id-into-json.bash 4. ./insert-title-into-json.bash 5. ./insert-date-into-json.bash Worked out great.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
sickprodigy
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sickprodigy/TubeArchivist-Scripts#1
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?