SMARD not working

[MG-ng]

Hey everyone,
May it be the case that the integration of the SMARD (Strommarktdaten für Deutschland) API was only an idea and has not yet been implemented?
The setup.py mentioned in the docs doesn't really make sense, I think.

deutschland/docs/smard/README.md

Line 34 in fb151d0

python setup.py install --user

[wirthual]

Hi,

the most up to date README can be found here.

The api is included in the deutschland package by default so a simple pip install deutschland should allow you to use the smard package as described in the README from above.

Here an example script which allowed me to get data:

import time
from deutschland import smard
from pprint import pprint
from deutschland.smard.api import default_api
from deutschland.smard.model.indices import Indices
from deutschland.smard.model.time_series import TimeSeries
# Defining the host is optional and defaults to https://www.smard.de/app/chart_data
# See configuration.py for a list of all supported configuration parameters.
configuration = smard.Configuration(
    host = "https://www.smard.de/app/chart_data"
)



# Enter a context with an instance of the API client
with smard.ApiClient(configuration) as api_client:
    # Create an instance of the API class
    api_instance = default_api.DefaultApi(api_client)
    filter = 1223 # int | Mögliche Filter:   * `1223` - Stromerzeugung: Braunkohle   * `1224` - Stromerzeugung: Kernenergie   * `1225` - Stromerzeugung: Wind Offshore   * `1226` - Stromerzeugung: Wasserkraft   * `1227` - Stromerzeugung: Sonstige Konventionelle   * `1228` - Stromerzeugung: Sonstige Erneuerbare   * `4066` - Stromerzeugung: Biomasse   * `4067` - Stromerzeugung: Wind Onshore   * `4068` - Stromerzeugung: Photovoltaik   * `4069` - Stromerzeugung: Steinkohle   * `4070` - Stromerzeugung: Pumpspeicher   * `4071` - Stromerzeugung: Erdgas   * `410` - Stromverbrauch: Gesamt (Netzlast)   * `4359` - Stromverbrauch: Residuallast   * `4387` - Stromverbrauch: Pumpspeicher 
    filter_copy = 1223 # int | Muss dem Wert von \"filter\" entsprechen. (Kaputtes API-Design) 
    region = "DE" # str | Land / Regelzone / Marktgebiet:   * `DE` - Land: Deutschland   * `AT` - Land: Österreich   * `LU` - Land: Luxemburg   * `DE-LU` - Marktgebiet: DE/LU (ab 01.10.2018)   * `DE-AT-LU` - Marktgebiet: DE/AT/LU (bis 30.09.2018)   * `50Hertz` - Regelzone (DE): 50Hertz   * `Amprion`- Regelzone (DE): Amprion   * `TenneT` - Regelzone (DE): TenneT   * `TransnetBW` - Regelzone (DE): TransnetBW   * `APG` - Regelzone (AT): APG   * `Creos` - Regelzone (LU): Creos  (default to "DE")
    region_copy = "DE" # str | Muss dem Wert von \"region\" entsprechen. (Kaputtes API-Design) 
    resolution = "hour" # str | Auflösung der Daten:   * `hour` - Stündlich   * `quater_hour` - Viertelstündlich   * `day` - Täglich   * `week` - Wöchentlich   * `month` - Monatlich   * `year` - Jährlich  (default to "hour")
    timestamp = 1627855200000 # int | 

    try:
        # Zeitreihendaten
        api_response = api_instance.filter_region_filter_copy_region_copy_resolution_timestamp_json_get(filter=filter,filter_copy=filter,region=region,region_copy=region_copy,timestamp=timestamp)
        pprint(api_response)
    except smard.ApiException as e:
        print("Exception when calling DefaultApi->filter_region_filter_copy_region_copy_resolution_timestamp_json_get: %s\n" % e)

Result:

{'meta_data': {'created': 1736776103233, 'version': 1},
 'series': [[1627855200000.0, 8994.75],
            [1627858800000.0, 8267.25],
            [1627862400000.0, 7138.5],
            [1627866000000.0, 6940.0],
            [1627869600000.0, 7611.0],
            [1627873200000.0, 8914.5],
            [1627876800000.0, 10564.0],
            [1627880400000.0, 10642.75],
            [1627884000000.0, 10738.5],
             ...
}

In case you find an missmatch with the openapi description here or see missing features, we are open for contributions.

[MG-ng]

Thank you for your answer!
Do you know which filter I have to use in order to get the market prices from the price zone DE-AT-LU before the 1.10.2018 when Austria got its own zone?
I can get this data on the SMARD website https://www.smard.de/home/downloadcenter/download-marktdaten/
but don't understand how these drop down selections translate in here.

[wirthual]

You can use the example from above and adapt the parameters like this:

    filter = 1223 # int | Mögliche Filter:   * `1223` - Stromerzeugung: Braunkohle   * `1224` - Stromerzeugung: Kernenergie   * `1225` - Stromerzeugung: Wind Offshore   * `1226` - Stromerzeugung: Wasserkraft   * `1227` - Stromerzeugung: Sonstige Konventionelle   * `1228` - Stromerzeugung: Sonstige Erneuerbare   * `4066` - Stromerzeugung: Biomasse   * `4067` - Stromerzeugung: Wind Onshore   * `4068` - Stromerzeugung: Photovoltaik   * `4069` - Stromerzeugung: Steinkohle   * `4070` - Stromerzeugung: Pumpspeicher   * `4071` - Stromerzeugung: Erdgas   * `410` - Stromverbrauch: Gesamt (Netzlast)   * `4359` - Stromverbrauch: Residuallast   * `4387` - Stromverbrauch: Pumpspeicher 
    filter_copy = 1223 # int | Muss dem Wert von \"filter\" entsprechen. (Kaputtes API-Design) 
    region = "DE-AT-LU" # str | Land / Regelzone / Marktgebiet:   * `DE` - Land: Deutschland   * `AT` - Land: Österreich   * `LU` - Land: Luxemburg   * `DE-LU` - Marktgebiet: DE/LU (ab 01.10.2018)   * `DE-AT-LU` - Marktgebiet: DE/AT/LU (bis 30.09.2018)   * `50Hertz` - Regelzone (DE): 50Hertz   * `Amprion`- Regelzone (DE): Amprion   * `TenneT` - Regelzone (DE): TenneT   * `TransnetBW` - Regelzone (DE): TransnetBW   * `APG` - Regelzone (AT): APG   * `Creos` - Regelzone (LU): Creos  (default to "DE")
    region_copy = "DE-AT-LU" # str | Muss dem Wert von \"region\" entsprechen. (Kaputtes API-Design) 
    timestamp = 1514761200000 # int | Timestamp in Milliseconds

Which results in:

{'meta_data': {'created': 1736773775981, 'version': 1},
 'series': [[1514761200000.0, 6723.75],
            [1514764800000.0, 6810.0],
            [1514768400000.0, 6765.75],
            [1514772000000.0, 6728.0],
            [1514775600000.0, 6709.75],

[MG-ng]

Sorry for this late reply, but your answer didn't really solved what I asked for. Your filter is set to lignite electricity production but I asked for old electricity prices.
I've written a script to demonstrate what I mean:

Python Code

import json, pytz
from requests import get
from datetime import datetime

def convert_unix_timestamp(timestamp, is_milliseconds=True):
    if is_milliseconds:
        timestamp = timestamp / 1000.0  # Convert milliseconds to seconds
    dt_object = datetime.fromtimestamp(timestamp, pytz.timezone("Europe/Berlin"))
    return dt_object.strftime('%Y-%m-%d %H:%M:%S')

FLAG = -1e8
baseURL = "https://www.smard.de/app"
priceFilterDict = {
    4169: "Marktpreis: Deutschland/Luxemburg",
    5078: "Marktpreis: Anrainer DE/LU",
    4170: "Marktpreis: Österreich"
}
priceFilter = list( priceFilterDict.keys() )
print(priceFilter, priceFilterDict)
bucketList = {}
timestampBuckets = []

# First get the rows with the Timestamp Buckets
timestampedRows: list = []
for resolution in ["day"]:
    for region in ["DE-AT-LU", "DE-LU", "AT"]:  # REGION_LIST:
        for filterIndex, currentFilter in enumerate( priceFilter ):
            response = get( f"{baseURL}/chart_data/{currentFilter}/{region}/index_{resolution}.json" )
            try:
                print( response.url, response.status_code )
                timestampBuckets = json.loads(response.content.decode())[ "timestamps" ]
            except Exception as e:
                if response.status_code == 404:
                    continue
                print( e )

            for timestamp in timestampBuckets:
                timestampedRows.append( (timestamp, True, region, resolution, *[None] * filterIndex, FLAG, *[None] * (
                            len( priceFilter ) -filterIndex-1) ) )
                response = get( f"{baseURL}/chart_data/{currentFilter}/{region}/{currentFilter}_{region}_{resolution}_{timestamp}.json" )
                data = json.loads( response.content.decode() )

                for tuple in data["series"]:
                    # print(data)  # {…, 'series': [[1420066800000, 12508.5], [1420153200000, None]] }
                    if tuple[1] != None:
                        timestampedRows.append( (tuple[ 0 ], False, region, resolution,
                             *[None] * filterIndex, tuple[1], *[None] * (len(priceFilter)-filterIndex-1) ) )

            bucketList[ str(currentFilter) +"-"+ region +"-"+ resolution ] = timestampedRows
            timestampedRows = []

print("Result:")

for key in bucketList:
    print( key, " - " + priceFilterDict[ int(key.split("-")[0]) ] )
    timestampedRows = bucketList[ key ]
    timestampedRows.sort( key = lambda row: row[ 0 ] )
    for i in range( 3 ):  # print earliest x datapoints in the API
        print( convert_unix_timestamp(timestampedRows[i][0]), timestampedRows[i] )

With the following output:

Command line Output

[4169, 5078, 4170] {4169: 'Marktpreis: Deutschland/Luxemburg', 5078: 'Marktpreis: Anrainer DE/LU', 4170: 'Marktpreis: Österreich'}
https://www.smard.de/app/chart_data/4169/DE-AT-LU/index_day.json 200
https://www.smard.de/app/chart_data/5078/DE-AT-LU/index_day.json 404
https://www.smard.de/app/chart_data/4170/DE-AT-LU/index_day.json 200
https://www.smard.de/app/chart_data/4169/DE-LU/index_day.json 200
https://www.smard.de/app/chart_data/5078/DE-LU/index_day.json 200
https://www.smard.de/app/chart_data/4170/DE-LU/index_day.json 200
https://www.smard.de/app/chart_data/4169/AT/index_day.json 200
https://www.smard.de/app/chart_data/5078/AT/index_day.json 404
https://www.smard.de/app/chart_data/4170/AT/index_day.json 200
Result:
4169-DE-AT-LU-day  - Marktpreis: Deutschland/Luxemburg
2018-01-01 00:00:00 (1514761200000, True, 'DE-AT-LU', 'day', -100000000.0, None, None)
2018-10-01 00:00:00 (1538344800000, False, 'DE-AT-LU', 'day', 61.24, None, None)
2018-10-02 00:00:00 (1538431200000, False, 'DE-AT-LU', 'day', 42.34, None, None)
4170-DE-AT-LU-day  - Marktpreis: Österreich
2018-01-01 00:00:00 (1514761200000, True, 'DE-AT-LU', 'day', None, None, -100000000.0)
2018-10-01 00:00:00 (1538344800000, False, 'DE-AT-LU', 'day', None, None, 63.19)
2018-10-02 00:00:00 (1538431200000, False, 'DE-AT-LU', 'day', None, None, 49.75)
4169-DE-LU-day  - Marktpreis: Deutschland/Luxemburg
2018-01-01 00:00:00 (1514761200000, True, 'DE-LU', 'day', -100000000.0, None, None)
2018-10-01 00:00:00 (1538344800000, False, 'DE-LU', 'day', 61.24, None, None)
2018-10-02 00:00:00 (1538431200000, False, 'DE-LU', 'day', 42.34, None, None)
5078-DE-LU-day  - Marktpreis: Anrainer DE/LU
2019-01-01 00:00:00 (1546297200000, True, 'DE-LU', 'day', None, -100000000.0, None)
2019-11-20 00:00:00 (1574204400000, False, 'DE-LU', 'day', None, 54.03, None)
2019-11-21 00:00:00 (1574290800000, False, 'DE-LU', 'day', None, 49.23, None)
4170-DE-LU-day  - Marktpreis: Österreich
2018-01-01 00:00:00 (1514761200000, True, 'DE-LU', 'day', None, None, -100000000.0)
2018-10-01 00:00:00 (1538344800000, False, 'DE-LU', 'day', None, None, 63.19)
2018-10-02 00:00:00 (1538431200000, False, 'DE-LU', 'day', None, None, 49.75)
4169-AT-day  - Marktpreis: Deutschland/Luxemburg
2018-01-01 00:00:00 (1514761200000, True, 'AT', 'day', -100000000.0, None, None)
2018-10-01 00:00:00 (1538344800000, False, 'AT', 'day', 61.24, None, None)
2018-10-02 00:00:00 (1538431200000, False, 'AT', 'day', 42.34, None, None)
4170-AT-day  - Marktpreis: Österreich
2018-01-01 00:00:00 (1514761200000, True, 'AT', 'day', None, None, -100000000.0)
2018-10-01 00:00:00 (1538344800000, False, 'AT', 'day', None, None, 63.19)
2018-10-02 00:00:00 (1538431200000, False, 'AT', 'day', None, None, 49.75)

As you can see, the earliest date where data is available is the 1.10.2018.
But on the website, there is older data! How does this work then?