Containers/discord-downloader-go: From upstream https://github.com/get-got/discord-downloader-go.git Modified for arm64 @ d9a4f8a81bd17e2e373a440ab9b0f1d26137eabc

From upstream https://github.com/get-got/discord-downloader-go.git
Modified for arm64 https://github.com/get-got/discord-downloader-go.git

693 Commits

1 Branches

0 Releases

Drn d9a4f8a81b readme		2 years ago
.gitattributes	f36da52ba8 Initial commit.	4 years ago
.gitignore	3cd8f283a5 history range check fix	2 years ago
.travis.yml	845409f864 reddit fix for travis	2 years ago
Dockerfile	0327fb676a reddit fix for docker	2 years ago
LICENSE	f36da52ba8 Initial commit.	4 years ago
README.md	d9a4f8a81b readme	2 years ago
commands.go	4f574100ce Update commands.go	2 years ago
common.go	d9a4f8a81b readme	2 years ago
config.go	8dd82b0815 filename & behavior default change	2 years ago
database.go	b93abc65b9 goification3	2 years ago
discord.go	0b7c73fbaf status colors, status log settings modifications	2 years ago
downloads.go	bd97479f7f Update downloads.go	2 years ago
go.mod	57e8697d65 Update go.mod	2 years ago
go.sum	6125fa0d84 go.mod	2 years ago
handlers.go	2a47761067 fix duplicate handlers	2 years ago
history.go	a3df40f70d historyMaxJobs, RUNS IN ORDER!!, list works way better	2 years ago
main.go	d9a4f8a81b readme	2 years ago
parse.go	ae2bc9d249 instagram api support	2 years ago
regex.go	ae2bc9d249 instagram api support	2 years ago
vars.go	407805f809 vb	2 years ago

Discord Downloader <i>Go</i>

<a href="https://travis-ci.com/get-got/discord-downloader-go" alt="Travis Build">
    <img src="https://travis-ci.com/get-got/discord-downloader-go.svg?branch=master" />
</a>
<a href="https://hub.docker.com/r/getgot/discord-downloader-go" alt="Docker Build">
    <img src="https://img.shields.io/docker/cloud/build/getgot/discord-downloader-go" />
</a>
<a href="https://goreportcard.com/report/github.com/get-got/discord-downloader-go" alt="Go Report Card">
    <img src="https://goreportcard.com/badge/github.com/get-got/discord-downloader-go" />
</a>
<br>
<a href="https://github.com/get-got/discord-downloader-go/releases" alt="All Releases">
    <img src="https://img.shields.io/github/downloads/get-got/discord-downloader-go/total?label=all-releases&logo=GitHub" />
</a>
<a href="https://hub.docker.com/r/getgot/discord-downloader-go" alt="Docker Pulls">
    <img src="https://img.shields.io/docker/pulls/getgot/discord-downloader-go?label=docker-pulls&logo=Docker" />
</a>
<a href="https://github.com/get-got/discord-downloader-go/releases/latest" alt="Latest Release">
    <img src="https://img.shields.io/github/downloads/get-got/discord-downloader-go/latest/total?label=latest-release&logo=GitHub" />
</a>
<br>
<a href="https://discord.gg/6Z6FJZVaDV">
    <img src="https://img.shields.io/discord/780985109608005703?logo=discord"alt="Join the Discord">
</a>

<a href="https://discord.com/invite/6Z6FJZVaDV">
    <b>Need help? Have suggestions? Join the Discord server!</b>
</a>
<br/><br/>
<a href="https://github.com/get-got/discord-downloader-go/releases/latest">
    <b>DOWNLOAD LATEST RELEASE</b>
</a>

Operating System	Architectures ( ? = available but untested )
Windows	amd64, arm64 (?), armv7/6/5 (?), 386 (?)
Linux	amd64, arm64, armv7/6/5, risc-v64 (?), mips64/64le (?), s390x (?), 386 (?)
Darwin (Mac)	amd64 (?), arm64 (?)
FreeBSD	amd64 (?), arm64 (?), armv7/6/5 (?), 386 (?)
OpenBSD	amd64 (?), arm64 (?), armv7/6/5 (?), 386 (?)
NetBSD	amd64 (?), arm64 (?), armv7/6/5 (?), 386 (?)

This project is a cross-platform cli single-file program to interact with a Discord Bot (genuine bot application or user account, limitations apply to both respectively) to locally download files posted from Discord in real-time as well as a full archive of old messages. It can download any directly sent Discord attachments or linked files and supports fetching highest possible quality files from specific sources (see list below). It also supports very extensive settings configurations and customization, applicable globally or per-server/category/channel/user. Tailor the bot to your exact needs and runtime environment. See the Features list below for the full list. See the List of Settings below for a settings breakdown. See Getting Started or anything else in the table of contents right under this to learn more!

<b>Originally a fork of <a href="https://github.com/Seklfreak/discord-image-downloader-go">Seklfreak's <i>discord-image-downloader-go</i></a></b>

The original project was abandoned, for a list of differences and why I made an independent project, <a href="#differences-from-seklfreaks-discord-image-downloader-go--why-i-made-this"><b>see below</b></a>

⚠️ WARNING! Discord does not allow Automated User Accounts (Self-Bots/User-Bots)
🤖 Features
- Supported Download Sources
- Commands
✔️ Getting Started
📚 Guide: Downloading History (Old Messages)
- Command Arguments
- Examples
🔨 Guide: Settings / Configuration
🛠 List of Settings
🤖 Settings Examples
❔ FAQ
⚙️ Development

⚠️ WARNING! Discord does not allow Automated User Accounts (Self-Bots/User-Bots)

While this project works for user logins, I do not reccomend it as you risk account termination. If you can, use a proper Discord Bot user for this program.

NOTE: This only applies to real User Accounts, not Bot users. This program currently works for either.

Now that that's out of the way...

🤖 Features

Supported Download Sources

Direct Links to Files
Discord File Attachments
Twitter (requires API key, see config section)
Instagram (requires account login, see config section)
Reddit
Imgur
Streamable
Gfycat
Tistory
Flickr (requires API key, see config section)
I'll always welcome requests but some sources can be tricky to parse...

Commands

Commands are used as ddg <command> <?arguments?> (unless you've changed the prefix) Command | Arguments? | Description --- | --- | --- help, commands | No | Lists all commands. ping, test | No | Pings the bot. info | No | Displays relevant Discord info. status | No | Shows the status of the bot. stats | No | Shows channel stats. history | SEE HISTORY SECTION | (BOT AND SERVER ADMINS ONLY) Processes history for old messages in channel. exit, kill, reload | No | (BOT ADMINS ONLY) Exits the bot (or restarts if using a keep-alive process manager). emojis | Optionally specify server IDs to download emojis from; separate by commas | (BOT ADMINS ONLY) Saves all emojis for channel.

✔️ Getting Started

Confused? Try looking at the step-by-step list.

Depending on your purpose for this program, there are various ways you can run it.

Run the executable file for your platform. (Process managers like pm2 work well for this)
Run the executable file via command prompt. (discord-downloader-go.exe settings2 or similar to run multiple instances sharing a database with separate settings files)
Run automated image builds in Docker. (Google it).
- Mount your settings.json to /root/settings.json
- Mount a folder named "database" to /root/database
- Mount your save folders or the parent of your save folders within /root/
- i.e. X:\My Folder to /root/My Folder
Install Golang and compile/run the source code yourself. (Google it)

You can either create a settings.json following the examples & variables listed below, or have the program create a default file (if it is missing when you run the program, it will make one, and ask you if you want to enter in basic info for the new file).

Getting Started Step-by-Step

Download & put executable within it's own folder.
Configure Main Settings (or run once to have settings generated). (SEE BELOW)
Enter your login credentials in the "credentials" section. (SEE BELOW)
Put your Discord User ID as in the "admins" list of the settings. (SEE BELOW)
Put a Discord Channel ID for a private channel you have access to into the "adminChannels". (SEE BELOW)
Put your desired Discord Channel IDs into th6e "channels" section. (SEE BELOW)
- I know it can be confusing if you don't have experience with programming or JSON in general, but this was the ideal setup for extensive configuration like this. Just be careful with comma & quote placement and you should be fine. See examples below for help.

Bot Login Credentials

If using a Bot Application, enter the token into the "token" setting. Remove the lines for "username" and "password" or leave blank (""). To create a Bot User, go to discord.com/developers/applications and create a New Application. Once created, go to Bot and create. The token can be found on the Bot page. To invite to your server(s), go to OAuth2 and check "bot", copy the url, paste into browser and follow prompts for adding to server(s).
If using a User Account (Self-Bot) WITHOUT 2FA (2-Factor Authentication), fill out the "username" and "password" settings. Remove the line for "token" or leave blank ("").
If using a User Account (Self-Bot) WITH 2FA (2-Factor Authentication), enter the token into the "token" setting. Remove the lines for "username" and "password" or leave blank (""). Your account token can be found by opening the browser console / dev tools / inspect element > Network tab > filter for "library" and reload the page if nothing appears. Assuming there is an item that looks like the below screenshot, click it and find "Authorization" within the "Request Headers" section of the Headers tab. The random text is your token.

Permissions in Discord

In order to perform basic downloading functions, the bot will need Read Message permissions in the server(s) of your designated channel(s).
In order to respond to commands, the bot will need Send Message permissions in the server(s) of your designated channel(s). If executing commands via an Admin Channel, the bot will only need Send Message permissions for that channel, and that permission will not be required for the source channel.
In order to process history commands, the bot will need Read Message History permissions in the server(s) of your designated channel(s).

Bot Intents for Discord Application Bots

NECESSARY IF USING A GENUINE DISCORD APPLICATION

Go to the Discord Application management page, choose your application, go to the Bot category, and ensure Message Content Intent is enabled.

How to Find Discord IDs

Use the info command!
Discord Developer Mode: Enable Developer Mode in Discord settings under Appearance.
Finding Channel ID: Enable Discord Developer Mode (see above), right click on the channel and Copy ID.
Finding User ID: Enable Discord Developer Mode (see above), right click on the user and Copy ID.
Finding Emoji ID: Enable Discord Developer Mode (see above), right click on the emoji and Copy ID.
Finding DM/PM ID: Inspect Element on the DM icon for the desired user. Look for href="/channels/@me/CHANNEL_ID_HERE". Using this ID in place of a normal channel ID should work perfectly fine.

Differences from Seklfreak's discord-image-downloader-go & Why I made this

Better command formatting & support
Configuration is JSON-based rather than ini to allow more elaborate settings and better organization. With this came many features such as channel-specific settings.
Channel-specific control of downloaded filetypes / content types (considers things like .mov as videos as well, rather than ignore them), Optional dividing of content types into separate folders.
(Optional) Reactions upon download success.
(Optional) Discord messages upon encountered errors.
Extensive bot status/presence customization.
Consistent Log Formatting, Color-Coded Logging
Somewhat different organization than original project; initially created from scratch then components ported over.
Various fixes, improvements, and dependency updates that I also contributed to Seklfreak's original project.

I've been a user of Seklfreak's project since ~2018 and it's been great for my uses, but there were certain aspects I wanted to expand upon, one of those being customization of channel configuration, and other features like message reactions upon success, differently formatted statuses, etc. If some aspects are rudimentary or messy, please make a pull request, as this is my first project using Go and I've learned everything from observation & Stack Overflow.

📚 Guide: Downloading History (Old Messages)

This guide is to show you how to make the bot go through all old messages in a channel and catalog them as though they were being sent right now, in order to download them all.

Command Arguments

If no channel IDs are specified, it will try and use the channel ID for the channel you're using the command in.

Argument / Flag	Details
channel ID(s)	One or more channel IDs, separated by commas if multiple.
`all`	Use all available registered channels.
`cancel` or `stop`	Stop downloading history for specified channel(s).
`list` or `status`	Output running history jobs in Discord & program.
`--since=YYYY-MM-DD`	Will process messages sent after this date.
`--since=message_id`	Will process messages sent after this message.
`--before=YYYY-MM-DD`	Will process messages sent before this date.
`--before=message_id`	Will process messages sent before this message.

Order of arguments does not matter

Examples

ddg history
ddg history cancel
ddg history all
ddg history stop all
ddg history 000111000111000
ddg history 000111000111000, 000222000222000
ddg history 000111000111000,000222000222000,000333000333000
ddg history 000111000111000, 000333000333000 cancel
ddg history 000111000111000 --before=000555000555000
ddg history 000111000111000 --since=2020-01-02
ddg history 000111000111000 --since=2020-10-12 --before=2021-05-06
ddg history 000111000111000 --since=000555000555000 --before=2021-05-06
ddg history status
ddg history list

🔨 Guide: Settings / Configuration

I tried to make the configuration as user friendly as possible, though you still need to follow proper JSON syntax (watch those commas). Most settings are optional and will use default values or be unused if missing from your settings file.

When initially launching the bot it will create a default settings file if you do not create your own settings.json manually. All JSON settings follow camelCase format.

If you have a config.ini from Seklfreak's discord-image-downloader-go, it will import settings if it's in the same folder as the program.

The bot accepts .json or .jsonc for comment-friendly json.

🛠 List of Settings

🛠 ... UNDER CONSTRUCTION ... 🔨

ALL SETTINGS WITH DEFAULT VALUES

{
    "credentials": {
        "token": "YOUR_USER_OR_BOT_TOKEN",
        "email": "YOUR_USER_EMAIL_NO_2FA",
        "password": "YOUR_USER_PASSWORD_NO_2FA",
        "twitterAccessToken": "",
        "twitterAccessTokenSecret": "",
        "twitterConsumerKey": "",
        "twitterConsumerSecret": "",
        "instagramUsername": "",
        "instagramPassword": "",
        "flickrApiKey": ""
    },

    "admins": [
        "YOUR_DISCORD_USER_ID"
    ],
    "adminChannels": [
        {
            "channel": "DISCORD_CHANNEL_ID_FOR_COMMANDS",
            "logProgram": false,
            "logStatus": true,
            "logErrors": true,
            "unlockCommands": false
        }
    ],

    "processLimit": 32,

    "debug": false,
    "settingsOutput": true,
    "messageOutput": true,
    "messageOutputHistory": false,

    "discordLogLevel": 0,
    "discordTimeout": 180,
    "downloadTimeout": 60,
    "downloadRetryMax": 3,
    "exitOnBadConnection": false,
    "githubUpdateChecking": true,

    "commandPrefix": "ddg ",
    "scanOwnMessages": false,
    "allowGeneralCommands": true,
    "inflateDownloadCount": 0,
    "europeanNumbers": false,

    "checkupRate": 30,
    "connectionCheckRate": 5,
    "presenceRefreshRate": 3,

    "save": true,
    "allowCommands": true,
    "scanEdits": true,
    "ignoreBots": true,

    "sendErrorMessages": true,
    "sendFileToChannel": "",
    "sendFileToChannels": [ "" ],
    "sendFileDirectly": true,
    "sendFileCaption": "",

    "filenameDateFormat": "2006-01-02_15-04-05",
    "filenameFormat": "{{date}} {{file}}",

    "presenceEnabled": true,
    "presenceStatus": "idle",
    "presenceType": 0,
    "presenceLabel": "{{timeSavedShort}} - {{countShort}} files",
    "presenceDetails": "{{timeSavedLong}}",
    "presenceDetails": "{{count}} files total",

    "reactWhenDownloaded": true,
    "reactWhenDownloadedEmoji": "",
    "reactWhenDownloadedHistory": false,
    "historyTyping": true,
    "embedColor": "",

    "historyMaxJobs": 3,
    "autoHistory": false,
    "autoHistoryBefore": "",
    "autoHistorySince": "",
    "sendAutoHistoryStatus": false,
    "sendHistoryStatus": true,

    "divideByYear": false,
    "divideByMonth": false,
    "divideByServer": false,
    "divideByChannel": false,
    "divideByUser": false,
    "divideByType": true,
    "divideFoldersUseID": false,
    "saveImages": true,
    "saveVideos": true,
    "saveAudioFiles": true,
    "saveTextFiles": false,
    "saveOtherFiles": false,
    "savePossibleDuplicates": true,
    "filters": {
        "blockedPhrases": [ "" ],
        "allowedPhrases": [ "" ],       
        "blockedUsers": [ "" ],
        "allowedUsers": [ "" ],       
        "blockedRoles": [ "" ],
        "allowedRoles": [ "" ],       
        "blockedExtensions": [
            ".htm",
            ".html",
            ".php",
            ".exe",
            ".dll",
            ".bin",
            ".cmd",
            ".sh",
            ".py",
            ".jar"
        ],
        "allowedExtensions": [ "" ],

        "blockedDomains": [ "" ],
        "allowedDomains": [ "" ]
    },

    "all": {
        "destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
    },
    "allBlacklistUsers": [ "" ],
    "allBlacklistServers": [ "" ],
    "allBlacklistCategories": [ "" ],
    "allBlacklistChannels": [ "" ],

    "users": [
        {
            "user": "SOURCE_DISCORD_USER_ID",
            "users": [ "SOURCE_DISCORD_USER_ID" ],
            "destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
        }
    ],

    "servers": [
        {
            "server": "SOURCE_DISCORD_SERVER_ID",
            "servers": [ "SOURCE_DISCORD_SERVER_ID" ],
            "serverBlacklist": [ "DISCORD_CHANNELS_TO_BLOCK" ],
            "destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
        }
    ],

    "categories": [
        {
            "category": "SOURCE_DISCORD_CATEGORY_ID",
            "categories": [ "SOURCE_DISCORD_CATEGORY_ID" ],
            "categoryBlacklist": [ "DISCORD_CHANNELS_TO_BLOCK" ],
            "destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
        }
    ],

    "channels": [
        {
            "channel": "SOURCE_DISCORD_CHANNEL_ID",
            "channels": [ "SOURCE_DISCORD_CHANNEL_ID" ],
            "destination": "files/example-folder",

            "enabled": true,
            "save": true,
            "allowCommands": true,
            "scanEdits": true,
            "ignoreBots": true,

            "sendErrorMessages": true,
            "sendFileToChannel": "",
            "sendFileToChannels": [ "" ],
            "sendFileDirectly": true,
            "sendFileCaption": "",

            "filenameDateFormat": "2006-01-02_15-04-05",
            "filenameFormat": "{{date}} {{file}}",

            "presenceEnabled": true,
            "reactWhenDownloaded": true,
            "reactWhenDownloadedEmoji": "",
            "reactWhenDownloadedHistory": false,
            "blacklistReactEmojis": [ "" ],
            "historyTyping": true,
            "embedColor": "",

            "autoHistory": false,
            "autoHistoryBefore": "",
            "autoHistorySince": "",
            "sendAutoHistoryStatus": false,
            "sendHistoryStatus": true,

            "divideByYear": false,
            "divideByMonth": false,
            "divideByServer": false,
            "divideByChannel": false,
            "divideByUser": false,
            "divideByType": true,
            "divideFoldersUseID": false,
            "saveImages": true,
            "saveVideos": true,
            "saveAudioFiles": true,
            "saveTextFiles": false,
            "saveOtherFiles": false,
            "savePossibleDuplicates": true,
            "filters": {
                "blockedPhrases": [ "" ],
                "allowedPhrases": [ "" ],

                "blockedUsers": [ "" ],
                "allowedUsers": [ "" ],

                "blockedRoles": [ "" ],
                "allowedRoles": [ "" ],

                "blockedExtensions": [
                    ".htm",
                    ".html",
                    ".php",
                    ".exe",
                    ".dll",
                    ".bin",
                    ".cmd",
                    ".sh",
                    ".py",
                    ".jar"
                ],
                "allowedExtensions": [ "" ],

                "blockedDomains": [ "" ],
                "allowedDomains": [ "" ]
            },

            "logLinks": {
                "destination": "",
                "destinationIsFolder": false,

                "divideLogsByServer": true,
                "divideLogsByChannel": true,
                "divideLogsByUser": false,
                "divideLogsByStatus": false,
                
                "logDownloads": true,
                "logFailures": true,

                "filterDuplicates": false,
                "prefix": "",
                "suffix": "",
                "userData": false
            },

            "logMessages": {
                "destination": "",
                "destinationIsFolder": false,

                "divideLogsByServer": true,
                "divideLogsByChannel": true,
                "divideLogsByUser": false,

                "filterDuplicates": false,
                "prefix": "",
                "suffix": "",
                "userData": false
            }

        }

    ]
}

settings - main

SETTING KEY	TYPE	DEFAULT	DESCRIPTION	EXAMPLE
credentials	`credentials group`		See `credentials group` below.
admins	array of strings	None	Discord IDs of users to use admin commands.	`"admins": [ "0", "0" ],`
adminChannels	array of `adminChannel groups`	None	See `adminChannel group` below.
discordLogLevel	int (whole number)	0 (errors)	0 = Errors, 1 = Warning, 2 = Informational, 3 = Debug	`"discordLogLevel": 2,`
debug	boolean (true or false)	false	Enables extra output for narrowing down problems.	`"debug": true,`
messageOutput	boolean (true or false)	true	Enables discord message output.	`"messageOutput": true,`

settings - credentials group

settings - adminChannels group

settings - source group

settings - source / filters group

settings - source / log group

🤖 Settings Examples

TODO: UNDER CONSTRUCTION

example - minimum bot app

example - minimum user account without 2FA

example - minimum user account with 2FA

example - server with friends

example - scraping public servers (user)

example - scraping public server (bot app, as admin)

❔ FAQ

Q: How do I install?
A: SEE #getting-started

Q: How do I convert from Seklfreak's discord-image-downloader-go?
A: Place your config.ini from that program in the same directory as this program and delete any settings.json file if present. The program will import your settings from the old project and make a new settings.json. It will still re-download files that DIDG already downloaded, as the database layout is different and the old database is not imported.

⚙️ Development

I'm a complete amateur with Golang. If anything's bad please make a pull request.
Follows Semantic Versioning: [MAJOR].[MINOR].[PATCH] https://semver.org/
github.com/Seklfreak/discord-image-downloader-go - the original project this was founded on

README.md