Integration of SR4HA by newLabAspect · Pull Request #2 · TUHH-IES/2024---Harshitha-Viswanath---Project-Work

newLabAspect · 2025-05-20T08:43:27Z

No description provided.

* Made transforms callable * Changed test to use new callable transform syntax

* Add rename transform * Add test for rename transform

* Add `preload_alp_data` script to convert data to single file * Adjust run example to use pre processed data * Remove old data folders * Add alp data back as parquet files

…cean#159) Bumps [com.google.protobuf:protobuf-java](https://github.com/protocolbuffers/protobuf) from 3.23.0 to 3.25.5. - [Release notes](https://github.com/protocolbuffers/protobuf/releases) - [Changelog](https://github.com/protocolbuffers/protobuf/blob/main/protobuf_release.bzl) - [Commits](protocolbuffers/protobuf@v3.23.0...v3.25.5) --- updated-dependencies: - dependency-name: com.google.protobuf:protobuf-java dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Add match_sampling_rate.py * Add seeds for all modules used in boiler example * Add function to initialize random states for different libraries * Fix test_train_test_split * Fix test_train_test_split * Set different random seeds for different libraries * Fix test

* Simplified row length check expression * Pin polars version to last working

…n#166)

* update landing page * add 'consider' * Flowcean is designed + Ref --------- Co-authored-by: Hendrik Rose <hendrik.willhelm.rose@tuhh.de>

* Implement high- and lowpass filter * Add test for high- and lowpass filter * Fixed comment * Fixed variable names * Fix import path * Fix old calling syntax * Rename from Filter to SignalFilter

* Implement one-hot transform * Add test for one-hot transform * Allow arbitrary data for one-hot * Remove integer test * Added optional argument for categorical values * Move creation from dataframe into static creation method * Adjust tests to use new creation method * Add test for explicit categories * Added docstring for `from_dataframe` method * Add check for missing values/categories * Adjust calling and overloads to new syntax * Fix typo * Remove comment * Move check_for_missing_categories to constructor / init * Fix test

* Introduce uv for project management * update documentation * mv LICENSE.txt -> LICENSE * emojies * preparation for automatic releases * improve documentation * PEP723 script inline metadata * add cd in installation guide

* Add itl-nas remote * Remove new line

* Add one-cold transform with tests * Improved inline documentation * Add example in main docstring * Fix typo

* Add filter transform with test * Add sympy as explicit dependency * Update lock file with sympy * Replace filter_mode with class based system * Remove old literal type * Sort __all__ * Add examples in docstring * Add docstring for FilterExpression

* Reworked transforms and environments to yield LazyFrames * Fix tests to work with lazy frames * Fix way to get column names of lazy frames * Fix tests for lazy frames * Change learner inputs and outputs back to DataFrame * Fix some typo violations * Add caching for Dataset length * Fixed bad data types in models and learners * Remove todo comment. Code is going to change anyway * Fix more type problems * Adapt Cast transform to lazy * Fix bad return * Fix streaming environment not working with lazy frames * Fix Lambda transform signature * Fix new transforms for lazy processing * Fix error in ode_environment test

* Reset on main * Move deps to dev-dependencies * Move deps to dev-dependencies

* add a script to save particle cloud images * plot particle position and orientation * plot mean positions of the particles * plot particle mean orientation * rotate plot by mean orientation * before and after rotation comparison * discard the particles outside the defined region * save the plot as 36x36 pixel image * process and generate images from cached ros json data * create a polars time series df containing images * Create particle cloud image transform class * rename and cleanup * Improve data processing * Improve image processing * use numpy vectorization * delete outdated files * push run.py * Optimize memory usage and speed * make ruff happy * Apply pre-commit fixes: updated .gitignore * Fix ruff formatting issues * update test assertion * Add tests for particle cloud image transform * fix ruff * Keep particle cloud feature * fix ruff * organize files * apply transforms in sequence * uv.lock * delete particle cloud statistics transform * remove ParticleCloudStatistics from exports --------- Co-authored-by: Markus Knitt <markus.knitt@tuhh.de>

* Add first transform with test * Add Last transform with tests * Add optional replace flag

* Add median transform * Update src/flowcean/polars/transforms/median.py Co-authored-by: Maximilian Schmidt <maximilian@schmidt.so> --------- Co-authored-by: Maximilian Schmidt <maximilian@schmidt.so>

* Add mean transform for time series data * Add non-destructive calculation * Update src/flowcean/polars/transforms/mean.py Co-authored-by: Maximilian Schmidt <maximilian@schmidt.so> * Add replace flag --------- Co-authored-by: Maximilian Schmidt <maximilian@schmidt.so>

* Add replace flag and test for feature replacement * Extend median test

* Add Mode transform with tests * Add helper method to get the time series datatype * Fixed disabled tests * Return the first mode if multiple values have the same occurrence count * Fix multi mode behaviour and added test * Return the largest mode if there are multiple

… time series features (flowcean#242) * Add support for nearest interpolation method * Add fill strategy for missing interpolation values * Add test for scalar time series * Add support scalar time series

* Add localization status transform * Add test for localization status transform

* Add unnest transform * Remove numpy import * Rename test and add example

* Add dictionary support for cast and test new argument option * Update docstring

…verter

newLabAspect

Please add typing. Maybe you could run the flowcean checks on your side.

newLabAspect · 2025-05-20T08:47:03Z

+def main() -> None:
+    flowcean.cli.initialize_logging()
+
+    data = DataFrame.from_uri(uri="file:C:/Users/49157/Desktop/PA/SR_Original_code/SymbolicRegression4HA/data/converter/short_wto_zeros_data_converter_omega400e3_beta40e3_Q10_theta60.csv")


This won't work for other people. Add the data to DVC and make it a relative path

newLabAspect · 2025-05-20T08:48:32Z

Do not track these files. Those are artifacty.

newLabAspect · 2025-05-20T08:48:42Z

Do not track these files. Those are artifacty.

newLabAspect · 2025-05-20T08:54:33Z

Add typing.

newLabAspect · 2025-05-20T08:55:58Z

This should be a derived class of Transform.

newLabAspect · 2025-05-20T09:27:34Z

the output should not be part of the inputs.

newLabAspect · 2025-05-20T09:27:50Z

remove commented code.

newLabAspect · 2025-05-20T09:32:29Z

just put a pass here for now as we do not use this here.

newLabAspect · 2025-05-20T09:32:43Z

just put a pass here for now as we do not use this here.

newLabAspect · 2025-05-20T09:33:10Z

remove unused code.

newLabAspect · 2025-06-03T10:19:38Z

+# Load the CSV
+df = pd.read_csv("C:/Users/49157/Documents/MATLAB/buck_converter_output.csv")
+
+# Strip any extra spaces from column names just in case


Why is this necessary?

newLabAspect · 2025-06-03T10:21:02Z

+df = pd.read_csv("hybrid_sensor_data.csv")
+df_subset = df.head(2000)
+df_subset.to_csv('sampled_data.csv', index=False)
+print("First 2000 datapoints have been saved to sampled_data.csv")


rather use logging than printing

newLabAspect · 2025-06-03T10:21:26Z

+df_subset.to_csv('sampled_data.csv', index=False)
+print("First 2000 datapoints have been saved to sampled_data.csv")
+
+# Get the total number of rows in the DataFrame


Remove all commented code

newLabAspect · 2025-06-03T10:22:30Z

Add some description as a header? And add documentation, if possible.

newLabAspect · 2025-06-03T10:23:51Z

Is this the same as the csv read for the other example?
Why not turning this into a transform which just slices the first samples?

newLabAspect · 2025-06-03T10:24:16Z

Add descirption or documentation.

newLabAspect · 2025-06-03T10:26:02Z

                X_train = current_frame[self.learner.feature_names]
                y_train = current_frame[self.target_var]
                self.learner.fit(X_train, y_train)
+                print(self.learner.get_best())       # Debug


Remove this or change to useful logging

Updated STD

…tSen-STD.png

schmidma and others added 30 commits August 16, 2024 05:10

Adjust pyproject.toml for publishing (flowcean#154)

001355e

Make transforms callable (flowcean#151)

558e8d0

* Made transforms callable * Changed test to use new callable transform syntax

Add Rename transform (flowcean#155)

7aff1cf

* Add rename transform * Add test for rename transform

Pack ALP data into single files (flowcean#147)

8a905dd

* Add `preload_alp_data` script to convert data to single file * Adjust run example to use pre processed data * Remove old data folders * Add alp data back as parquet files

Add write_parquet method to offline environments (flowcean#146)

8218650

Pin polars version to 1.9 (flowcean#165)

f81d99a

* Simplified row length check expression * Pin polars version to last working

lego bricks for environments (flowcean#160)

44b556d

Unpin polars and limit version to latest one with the bugfix (flowcea…

f636750

…n#166)

Update landing page (flowcean#148)

c298932

* update landing page * add 'consider' * Flowcean is designed + Ref --------- Co-authored-by: Hendrik Rose <hendrik.willhelm.rose@tuhh.de>

Replace ww3.tuhh.de with new flowcean.me domain (flowcean#170)

d99f07d

Add Time series filter (flowcean#129)

7b46bc2

* Implement high- and lowpass filter * Add test for high- and lowpass filter * Fixed comment * Fixed variable names * Fix import path * Fix old calling syntax * Rename from Filter to SignalFilter

uv for project management (flowcean#167)

3356196

* Introduce uv for project management * update documentation * mv LICENSE.txt -> LICENSE * emojies * preparation for automatic releases * improve documentation * PEP723 script inline metadata * add cd in installation guide

publish release on tag push

72c3731

add permissions for creating releases

048111a

bump version to 0.3.0 (flowcean#174)

b4fe4db

Add itl-nas remote (flowcean#178)

c2f505f

* Add itl-nas remote * Remove new line

Add cast transform with test (flowcean#177)

06c405b

Add new rosbag to dvc (flowcean#180)

adebcaa

Add Lambda transform with test (flowcean#181)

3121389

Add drop transform (flowcean#182)

a0d695e

Add One-Cold transform (flowcean#117)

9ea9664

* Add one-cold transform with tests * Improved inline documentation * Add example in main docstring * Fix typo

Add Filter transform (flowcean#179)

0306233

* Add filter transform with test * Add sympy as explicit dependency * Update lock file with sympy * Replace filter_mode with class based system * Remove old literal type * Sort __all__ * Add examples in docstring * Add docstring for FilterExpression

Fix lazy frame usage in filter (flowcean#196)

b0a55ed

Add flowcean as editable dependency to scripts (flowcean#189)

f5f2ea3

Enable just for windows (flowcean#195)

33c252f

Add trailing commas (flowcean#197)

8611e75

mknitt and others added 15 commits February 18, 2025 15:04

Scan and map transforms (flowcean#187)

d5d2863

* Reset on main * Move deps to dev-dependencies * Move deps to dev-dependencies

Move example dependencies into own group (flowcean#226)

f9ba6a0

First and Last transform for time series data (flowcean#229)

9afacbc

* Add first transform with test * Add Last transform with tests * Add optional replace flag

Median transform for time series data (flowcean#228)

570f565

* Add median transform * Update src/flowcean/polars/transforms/median.py Co-authored-by: Maximilian Schmidt <maximilian@schmidt.so> --------- Co-authored-by: Maximilian Schmidt <maximilian@schmidt.so>

Replace flag for Median transform (flowcean#231)

840da07

* Add replace flag and test for feature replacement * Extend median test

Dataset -> DataFrame (flowcean#220)

5e347af

241 matchsamplingrate transform sometimes returns different length of…

ca6ab5a

… time series features (flowcean#242) * Add support for nearest interpolation method * Add fill strategy for missing interpolation values * Add test for scalar time series * Add support scalar time series

Localization Status transform (flowcean#243)

c1efe37

* Add localization status transform * Add test for localization status transform

Add unnest transform (flowcean#244)

35c64fe

* Add unnest transform * Remove numpy import * Rename test and add example

Cast dictionary argument (flowcean#235)

14b241f

* Add dictionary support for cast and test new argument option * Update docstring

Update locked dependencies (flowcean#247)

a7e59c9

srlearn,srmodel, transforms/derivative.py, converter/run.py, dcdc_con…

7459ad8

…verter

newLabAspect commented May 20, 2025

View reviewed changes

HarshithaViswanath added 5 commits May 26, 2025 11:23

Revised Derivative code

f1c3b0c

Revised matlab code, and sampled_data.csv

7723cde

Smart Sensor example added

90844e3

SR learner code: modified

a768968

smart_sensor_1mode: correct results

d2ab6ac

newLabAspect commented Jun 3, 2025

View reviewed changes

HarshithaViswanath and others added 8 commits June 16, 2025 15:10

Added to results_img and Vehicle Cruise Example

96f1e35

Other results_img files for DCDC COnverter

328161b

srlear updated

d6887fb

examples, metrics-RMSE

ef6acdb

Add files via upload

171a30d

Updated STD

Delete examples/symbolic_regression/smart_sensor/sys_description/Smar…

af33857

…tSen-STD.png

Update derivative.py

d9b0486

Update srmodel.py

54e0210

Conversation

newLabAspect commented May 20, 2025

Uh oh!

newLabAspect left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants