Skip to content

feat(setup): Update pythong version to 3.12 for RDM#545

Open
sakshamarora1 wants to merge 1 commit into
CERNDocumentServer:masterfrom
sakshamarora1:upgrade_python
Open

feat(setup): Update pythong version to 3.12 for RDM#545
sakshamarora1 wants to merge 1 commit into
CERNDocumentServer:masterfrom
sakshamarora1:upgrade_python

Conversation

@sakshamarora1

Copy link
Copy Markdown
Contributor

closes: #543

Comment thread setup.cfg
sentry-sdk>=1.45,<2.0.0
cds-dojson @ git+https://github.com/CERNDocumentServer/cds-dojson@master#egg=cds-dojson
invenio-rdm-migrator>=5.0.0
setuptools<82.0.0 # `invenio-rdm-migrator` has a dependency on `pypeln` which depends on `pkg_resources`

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what about the invenio-query-parser dependency we discussed?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is pypeln needed in invenio-migrator? can we eliminate it? otherwise we are not upgrading for performance if we depend on older setuptools and calling pkg_resources somewhere in the code

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Invenio-query-parser problem is described above in the setup.cfg file

As for pypeln yes it's being used: https://github.com/search?q=repo%3Ainveniosoftware%2Finvenio-rdm-migrator%20pypeln&type=code
It could be possible to remove it from invenio-rdm-migrator, should I check with Alex?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it used for anything? If not then we can remove without involving Alex

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes

It is used for multi processing, in the transform run step and either we need to find an alternative for it or pin setuptools

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you finalise the upgrade without pinning setuptools?

Comment on lines +19 to +23
import collections
import collections.abc

collections.MutableMapping = collections.abc.MutableMapping
collections.Sequence = collections.abc.Sequence

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will this work in production image? for some time we will need backwards compatibility with 3.9 until we update invenio image to run newer versions

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No it is a breaking change, in python3.10
for backwards compatibility, i can add a try catch

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please make it work in both 3.9 and higher version because we are not yet ready to switch the prod image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

upgrade this repo to newer python version - check if this improves the performance

2 participants