Unable to add podcast based on HTML

[stefan1983]

I am unable to add a podcast to my PodGrab instance. When trying to add the Kyau & Albert podcast I get the error message "expected element type but have".

In my case the logs tell that the expected format is not rss but html, although adding in iTunes / Apple Podcasts and other podcast apps this is not an issue:

podgrab | [0.324ms] [rows:0] SELECT * FROM podcasts WHERE podcasts.url = "http://www.kyauandalbert.com/EuphonicSessions-Podcast-KyauandAlbert.xml" ORDER BY podcasts.id LIMIT 1
podgrab | http://www.kyauandalbert.com/EuphonicSessions-Podcast-KyauandAlbert.xml
podgrab | Response status: 503 Service Unavailable
podgrab | expected element type but have
podgrab | {"level":"dpanic","ts":1742215962.6436713,"caller":"zap@v1.16.0/sugar.go:191","msg":"Ignored key without a value.","ignored":"expected element type but have ","stacktrace":"go.uber.org/zap.(*SugaredLogger).Errorw\n\t/go/pkg/mod/go.uber.org/zap@v1.16.0/sugar.go:191\ngithub.com/akhilrex/podgrab/service.AddPodcast\n\t/api/service/podcastService.go:217\ngithub.com/akhilrex/podgrab/controllers.AddPodcast\n\t/api/controllers/podcast.go:406\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\nmain.setupSettings.func1\n\t/api/main.go:216\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/logger.go:241\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:489\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:445\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2843\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1925"}
podgrab | {"level":"error","ts":1742215962.6435215,"caller":"service/podcastService.go:217","msg":"Error adding podcast","stacktrace":"github.com/akhilrex/podgrab/service.AddPodcast\n\t/api/service/podcastService.go:217\ngithub.com/akhilrex/podgrab/controllers.AddPodcast\n\t/api/controllers/podcast.go:406\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\nmain.setupSettings.func1\n\t/api/main.go:216\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/logger.go:241\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:489\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:445\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2843\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1925"}
podgrab | [GIN] 2025/03/17 - 12:52:42 | 400 | 46.683917ms | 172.16.10.4 | POST "/podcasts"
podgrab | 2025/03/17 12:52:42 expected element type but have
podgrab |
podgrab | 2025/03/17 12:58:01 /api/db/dbfunctions.go:17 record not found
podgrab | [0.643ms] [rows:0] SELECT * FROM podcasts WHERE podcasts.url = "http://www.kyauandalbert.com/EuphonicSessions-Podcast-KyauandAlbert.xml" ORDER BY podcasts.id LIMIT 1
podgrab | http://www.kyauandalbert.com/EuphonicSessions-Podcast-KyauandAlbert.xml
podgrab | Response status: 503 Service Unavailable
podgrab | expected element type but have
podgrab | {"level":"dpanic","ts":1742216281.859208,"caller":"zap@v1.16.0/sugar.go:191","msg":"Ignored key without a value.","ignored":"expected element type but have ","stacktrace":"go.uber.org/zap.(*SugaredLogger).Errorw\n\t/go/pkg/mod/go.uber.org/zap@v1.16.0/sugar.go:191\ngithub.com/akhilrex/podgrab/service.AddPodcast\n\t/api/service/podcastService.go:217\ngithub.com/akhilrex/podgrab/controllers.AddPodcast\n\t/api/controllers/podcast.go:406\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\nmain.setupSettings.func1\n\t/api/main.go:216\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/logger.go:241\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:489\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:445\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2843\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1925"}
podgrab | {"level":"error","ts":1742216281.857981,"caller":"service/podcastService.go:217","msg":"Error adding podcast","stacktrace":"github.com/akhilrex/podgrab/service.AddPodcast\n\t/api/service/podcastService.go:217\ngithub.com/akhilrex/podgrab/controllers.AddPodcast\n\t/api/controllers/podcast.go:406\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\nmain.setupSettings.func1\n\t/api/main.go:216\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/logger.go:241\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/context.go:165\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:489\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/go/pkg/mod/github.com/gin-gonic/gin@v1.7.2/gin.go:445\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2843\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1925"}
podgrab | 2025/03/17 12:58:01 expected element type < rss > but have < html >
podgrab | [GIN] 2025/03/17 - 12:58:01 | 400 | 54.976235ms | 172.16.10.4 | POST "/podcasts">

[kimmerin]

Reason is the user agent:

$ curl -A "Go-http-client/1.1" http://www.kyauandalbert.com/EuphonicSessions-Podcast-KyauandAlbert.xml
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>503 Service Unavailable</title>
</head><body>
<h1>Service Unavailable</h1>
<p>The server is temporarily unable to service your
request due to maintenance downtime or capacity
problems. Please try again later.</p>
</body></html>

Same as #313 and #303 with yet another variation of how to communicate the fact that Go-clients are blocked from accessing the server.