[REQUEST] Automatic Export of CSV/XLS and HP template

[Dai]

Hello,

I'm trying since weeks to get this done but I don't get it.

What I try is an automatic export of all my data stored on the Netatmo website into a MySQL Database and view this data on my website.
System could be Linux/PHP/Shell/Synology whatever (but as I'm not an Pinguin System expert please step by step). I also tried it with a curl installation - but unfortunately without success - no data

All I need to know stands in the API documentation I know, but I'm absolutely sure that there are a few people out there who aren't that good in coding or don't have that much coding/linux skills including me.

The only "widget" I found was the widget from Potsky with current status but without history or charts. I already use it thank you.
Another possibility is Domoticz - nice views/charts but still not the data from the Netatmo site....also a nice system

Is there anyone who can help me/the community out or maybe the netatmo guys could provide some e.g. php templates with an easy step by step configuration list and not just a 400 pages API documentation with some code fragments...
Any idea would be helpful.

I think a lot of people would appriciate that.
Thanks in advance

PS: I already asked google but without any good information back.

[Dai]

No one who can bring an easy example how you can aut. download the data from the site ? Not even from Netatmo ??? Sad...

[frank_s]

Hi Dai,
have you checked this ?
https://www.michaelmiklis.de/export-net ... csv-excel/

Frank

[Dai]

Hi Frank,

I did but unfortunately ended with a couple of errors why I asked him for a step by step installations because I'm not a Linux user nor an Synology expert as obviously Mr. Miklis seems to be...no answer.

But thanks for your answer. But this idea goes into the right direction.

What is with the Netatmo Support staff ??? Why is there no example ??? I'm not meaning the API description

[frank_s]

Hi Dai,
I think it's just a question of integration but this is the tricky part.
I have copied the script already and will try to migrate it into my environment with my outdoor, rain, and wind device in near future.
I cannot post "my" solution here, because the original script is not mine.
What you need on your side is a (born) shell access from your hoster and a cron functionality to automate your tasks every minute. day, week, month or whenever.
Then you can get emails with csv-files.

Currently I am working on a raspberry pi weather data frontend which is mostly finished . Next I will check this script from M. Miklis because I also need it for my HP.

Finally, my opinion, don't ask for support from netatmo. this is a geek forum.

Viele Grüße
Frank

[wkoszyk]

It won't be that easy because of Netatmo API limits. You'll need to call Netatmo API few (or more!) times in order to download all your data. And it depends how accurate you want it to be - if you want to get every single row from every module you'll need hundreds of calls. Which means you need to know API and some programming language quite well.

When I've been doing my http://climategraphs.info at the beginning I wanted every user to authenticate and download such data and store in my MySQL database but I found it not useful. Every single day of every single module has about 260 rows. So for single device it's 260*365 = ~95000 rows. API has got 200 requests per 10s limit so you'll need to setup some timers in order to download all data correctly. That's why I gave up that idea.

I had somewhere that code (in NodeJS) but I haven't finished it and it's not the best I wrote. If you want I can give you that. I can't finish it because my wife would kill me (http://climategraphs.info took too much time in last few months) .

By the way - what's the HP template?

[frank_s]

I did but unfortunately ended with a couple of errors why I asked him for a step by step installations because I'm not a Linux user nor an Synology expert as obviously Mr. Miklis seems to be...no answer.

Script works fine for me, posted some infos there

[Dai]

Hi Dai,
I think it's just a question of integration but this is the tricky part.
I have copied the script already and will try to migrate it into my environment with my outdoor, rain, and wind device in near future.
I cannot post "my" solution here, because the original script is not mine.
What you need on your side is a (born) shell access from your hoster and a cron functionality to automate your tasks every minute. day, week, month or whenever.
Then you can get emails with csv-files.

Currently I am working on a raspberry pi weather data frontend which is mostly finished . Next I will check this script from M. Miklis because I also need it for my HP.

Finally, my opinion, don't ask for support from netatmo. this is a geek forum.

Viele Grüße
Frank

Thanks for your answer. Maybe some more germans read this and therefore I can explain it better I will write this post in my mother language.
Also jetzt mal Tacheles Ich bin kein großer Fan von Linux und kenn mich daher nur rudimentär aus. Ich hab eine Synology mit allen Zugriffsrechten, Mailserver etc. was ich theoretisch brauche.
Eigentlich hab ich auch curl installiert aber irgendwie klappt das script von dem Herren halt nicht. Mir fehlt da beim Linux mit der verquerten Schreibweise -> !*/()() usw. echt der Überblick was da eigentlich genau passiert und was nicht.
Ich kann dir gerne eine 1:1 Kopie der Fehler von seinem Skript schicken. Vielleicht wirst du ja schlau(er) draus.
Wenn ich diese CSV Datei hätte, könnte ich die nämlich aut. in meine SQL DB importieren und meine Auswertungen würden mal automatisiert ablaufen....
Ich geb die Hoffnung nicht auf das da vielleicht doch noch jemand mal seinen Zauberstab rausholt und hilft anstatt nur damit anzugeben was alles läuft. Deshalb ist man ja in einem Forum

In diesem Sinne
Aloah

[frank_s]

please check your PM

[Dai]

meanwhile my automatic export script runs but unfortunately still no answer of any Netatmo crew or anyone else regarding another template or anything else ???
As a hint if you find the script by searching netatmo export script in google - Linux and Windows have different declarations. Maybe your script is fine try dos2unix software if you're running on a windows machine. Thanks a lot to Frank again !