Kopernik - Ezgi Cakir, Ata Akin
Week One
Title: Weekly Updates on Kopernik
Date: 09/19/2021
Subject: Getting Started
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Satisfying necessary paperwork before starting the Kopernik Project.
Current Status
- Prof. Jones shared documentation for the status of the project for us to get started.
- Waiting for the scheduled weekly meeting to discuss the requirements and roles about the project.
Accomplishments
- Applied for CPT and got the new updated I-20s.
- Set up a time for weekly meetings with Prof. Jones, Andrew Deskur, Ata Akin and Ezgi Cakir.
Week Two
Title: Meeting with Andrew Deskur
Date: 09/26/2021
Subject: Kopernik Project Requirements
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Getting to know Andrew and understanding the needs of the project
- Role distribution for different aspects of the project; Ezgi taking part in FTP server and file operations to have a better performance than Wordpress while, Ata will be starting with Russian satellites and how to connect them to RPI to the same antenna using software
Current Status
- Took the credentials for VNC RPI environment and FTP server. There was a problem with the VNC which Andrew took care of during the week. Now we are able to connect to RPI through VNC. Connected to FTP server with Cyberduck taking necessary credentials. As the first step, coded a very simple Python program using ftplib to get a file into the FTP server.
- Later on Ezgi will be working on using FTP server to archive images of NOAA 15, 18 and 19 more than 7 days.
- Andrew shared links about setting up Russian satellites with NOAA satellites. We have started to research on how to use the same antenna to get images of the different satellites. Our goal is integrating RPI in a way to use both type of satellites.
Accomplishments
- Two files one jpeg and one docx documents successfully transferred to FTP server using simple Python code. The directory for the files is public_html/wp-content/gallery
Week Three
Title: Satellite Images
Date: 10/03/2021
Subject: NOAA15, NOAA18, NOAA19
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: 1) Executing the FTP server code from RPI 2) Putting related satellite images to their own folders
Ata: Researching more about how to set the RPI for Russian satellites
Current Status
- Got familiar with coding in RPI environment using text editors. Used the same simple FTP server code to send a file to the server from RPI.
- Examined prep_web_images.py which is the file about taking the satellite images from home/pi/weather/Today and pushes them to website. Started with python os library.
- Created separate folders for all NOAA satellites. Wrote a piece of code to only have the list of files in a certain path. Next step is to check the satellite images, take the satellite information and copy them to the relevant folders. I do not plan to move the files just yet because current system is displaying them from home/pi/weather/Today path. Instead I will copy the same images to their own folders. I am having a hard time to test the bit of the code in my own system due to lack of satellite images. After going through with python os more, I will test it during the week.
Accomplishments
- Created a directory for FTP server files and executed file transfer with FTP from RPI successfully.
- Found necessary files related to preparing web images (home/pi/weather/scripts/prep_web_images.py) and prepping the software for Russian satellites (home/pi/predict).
Week Four
Title: Satellite Images
Date: 10/10/2021
Subject: NOAA15, NOAA18, NOAA19
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: 1) Putting related satellite images to their own folders
Ata: Examining NOAA satellite codes to set the RPI for Russian satellites
Current Status
- Got agreed on copying the daily new satellite images to folders instead of moving them for the first step.
- Found related piece of code in home/pi/weather/Today/wp_bot.py to get png files in Today folder. I will be modifying the same code to collect different satellite images and then I will copy them to related directories.
Accomplishments
- I could not test the code in RPI because VNC stopped responding and currently, I am not able to use RPI. I have modified the code to get NOAA15, NOAA18 and NOAA19 satellite images separately.
- Next, I will copy those images to their related folders in RPI. Then, I will use FTP to send copied images to the server.
Week Five
Title: Satellite Images
Date: 10/17/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Putting related satellite images to their own folders
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
- We moved to meet time 1.00 pm to 3.30 pm.
Current Status
- Got agreed on copying the daily new satellite images to folders instead of moving them for the first step.
- Found related piece of code in home/pi/weather/Today/wp_bot.py to get png files in Today folder. I will be modifying the same code to collect different satellite images and then I will copy them to related directories.
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
-
Accomplishments
- I could not test the code in RPI because VNC stopped responding and currently, I am not able to use RPI. I have modified the code to get NOAA15, NOAA18 and NOAA19 satellite images separately.
- Next, I will copy those images to their related folders in RPI. Then, I will use FTP to send copied images to the server.
- I need to download some open-source software according to the guide I found but I didn't download it because I'm not sure.
Week Six
Title: Satellite Images
Date: 10/24/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Copying related satellite images to their own folders
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
- Working with ftp.py to take related satellite images and copy them to their folders. What I’m trying to do right now is: 1) Take related satellite images, 2) Change the directory to their related folders, 3) Copy the satellite images into the folders.
- Found related piece of code in home/pi/weather/Today/wp_bot.py to get png files in Today folder. Still modifying wp_bot.py.
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- We have a new NOAA GOES on VNC which is faster than the old one.
- Next, I will copy those images to their related folders in RPI. Then, I will use FTP to send copied images to the server.
- I need to download some open-source software according to the guide I found but I didn't download it because I'm not sure.
Week Seven
Title: Satellite Images
Date: 10/31/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Copying related satellite images to their own folders
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
Ezgi:
- Working with ftp.py to take related satellite images and copy them to their folders. What code includes currently:
1. Find the satellite images for NOAA15, NOAA18 and NOAA 19 and keep those in separate lists 2. Copies everything in the list to another list 3. Moves everything in the copied list to NOAA15, NOAA18 and NOAA19 folders
- Successfully modified previous code into a separate program which includes the elements I described above. Currently, I am debugging the program. Once it works properly, I will test it.
Ata:
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- Finished coding the program to copy satellite images to their own folders. I am getting some errors, but it should not be too hard to fix. I will spend time on debugging and testing the code.
- Next, I may have to figure out a way to program to run on its own every single day periodically.
Week Eight
Title: Satellite Images
Date: 11/07/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Copying related satellite images to their own folders
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
Ezgi:
- Working with ftp.py to take related satellite images and copy them to their folders. What code includes currently:
1. Find the satellite images for NOAA15, NOAA18 and NOAA 19 and keep those in separate lists (tested and successful)
2. Copies everything in the list to another list - debugging 3. Moves everything in the copied list to NOAA15, NOAA18 and NOAA19 folders - debugging
- In order to copy and move images, I will need to use os library of python. Right now the functions to copy and move do not use os library. Without os library, it is just treated as a string and not as images. I think the main problem I am facing right now is because I have used the wrong tools.
- There is a moveImages function that uses os library which I will modify a little to change the paths for different satellites. To copy images, I will need more digging.
Ata:
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- Fixed the main issue with the debugging and got the code working. It takes the file names successfully into separate lists. Copying them has become the main focus point.
- Next, I will modify moveImages function in the code after copyImages function.
Week Nine
Title: Satellite Images
Date: 11/14/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Copying related satellite images to their own folders
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
Ezgi:
- Working with ftp.py to take related satellite images and copy them to their folders. What code includes currently:
1. Find the satellite images for NOAA15, NOAA18 and NOAA 19 and keep those in separate lists (tested and successful)
2. Copies everything in the list to another list – changing the library and recoding 3. Moves everything in the copied list to NOAA15, NOAA18 and NOAA19 folders – code modified and is to be tested
- In order to copy and move images, I will need to use os library of python. Copy images function right now treats images as strings.
- I have modified moveImages function which already uses os library to move images. I have not tested the code yet because I do not want to move the original files. First, I will make sure I can make copies of the images, then I will move copied images to separate related folders.
Ata:
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- copyFiles function still needs modifying and debugging.
- I have modified moveFiles function and it is to be tested after figuring out copyFiles function.
Week Ten
Title: Satellite Images
Date: 11/21/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Debugging the code and using FTP server
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
Ezgi:
- Working with ftp.py to take related satellite images and copy them to their folders. What code includes currently:
1. Find the satellite images for NOAA15, NOAA18 and NOAA 19 and keep those in separate lists (tested and successful)
2. Copies everything in the list to another list – changing the library and recoding 3. Moves everything in the copied list to NOAA15, NOAA18 and NOAA19 folders – tested the code and currently debugging
- Debugging is taking awfully long time in RPI because currently the interpreter won’t see the changes I make to the code even though I save it couple of times. Also, I was coding at my own system and pasting to RPI but right now it won’t paste the copied code either.
- In debugging process I decided to test if it would move the NOAA15 satellite images to NOAA15 folder. Then I will modify it accordingly to copy the images instead of moving them. Furthermore, I will design the code in a way so that it does not repeat itself.
Ata:
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- copyFiles function still needs modifying and debugging.
- I have started debugging moveFiles function only using NOAA15.
- I will first test to see if the code moves NOAA15 files to NOAA15 folder. Then, I will look into copying them over and applying to other satellite images.
Week Eleven
Title: Satellite Images
Date: 11/28/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Sending all satellite images in /home/pi/weather/Today to FTP server.
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
Ezgi:
- Coded the program to send satellite images over to the FTP server with their original names as Prof. Jones requested instead of copying them over different folders.
- I have realized that we are not getting a new satellite images. The last ones we had were from 11/27. I also realized BiasT is not working, so I have checked the crontab and crontab logs. I notified Prof. Jones and Drew about it. I will be monitoring it to see if new images are clear or not.
Ata:
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- find_images finds satellites images in Today folder successfully and ftp_server sends them over to FTP with their original names successfully.
- Next steps; using a crontab to get the code executed hourly and using a control mechanism to make sure we only send new images into the FTP server.
\
]
Week Ten
Title: Satellite Images
Date: 11/21/2021
Subject: NOAA15, NOAA18, NOAA19, Meteor M2
Attendance: Ezgi Cakir, Ata Akin, Professor Jones, Andrew Deskur
Meeting Agenda
- Discussing further into the project and deciding on the next steps:
Ezgi: Debugging the code and using FTP server
Ata: Examining NOAA satellite codes and Meteor M2 codes to understand how to implement Meteor M2 weather satellite.
Current Status
Ezgi:
- Working with ftp.py to take related satellite images and copy them to their folders. What code includes currently:
1. Find the satellite images for NOAA15, NOAA18 and NOAA 19 and keep those in separate lists (tested and successful)
2. Copies everything in the list to another list – changing the library and recoding 3. Moves everything in the copied list to NOAA15, NOAA18 and NOAA19 folders – tested the code and currently debugging
- Debugging is taking awfully long time in RPI because currently the interpreter won’t see the changes I make to the code even though I save it couple of times. Also, I was coding at my own system and pasting to RPI but right now it won’t paste the copied code either.
- In debugging process I decided to test if it would move the NOAA15 satellite images to NOAA15 folder. Then I will modify it accordingly to copy the images instead of moving them. Furthermore, I will design the code in a way so that it does not repeat itself.
Ata:
- Found resources for implementing Meteor M2(https://www.instructables.com/Raspberry-Pi-NOAA-and-Meteor-M-2-Receiver/)
- Created copy of the scripts in home/pi/weather/predict to my computer to see how to follow through the guide for Meteor M2
Accomplishments
- copyFiles function still needs modifying and debugging.
- I have started debugging moveFiles function only using NOAA15.
- I will first test to see if the code moves NOAA15 files to NOAA15 folder. Then, I will look into copying them over and applying to other satellite images.
